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PRIORITY INFORMATION 



This application claims benefit of priority to the following provisional 
applications, each of which is hereby incorporated by reference in its entirety: 

Serial No. 60/263,573 filed January 22, 2001 titled Peer-to-Peer Network 
Computing Platform; 

Serial No. 60/268,893 filed February 14, 2001 titled Peer-to-Peer Network 
Computing Platform; 

Serial No. 60/286,225 filed April 24, 2001 titled Peer-to-Peer Network 
Computing Platform; and 

Serial No. 60/308,932 filed July 31, 2001 titled Trust Mechanism For A Peer-To- 
Peer Network Computing Platform. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to peer-to-peer networking, and more particularly to a 
system and method for establishing reliable connections between peers in a peer-to-peer 
networking environment. 

2. Description of the Related Art 

The Internet has three valuable fundamental assets — information, bandwidth, 
and computing resources — all of which are vastly underutilized, partly due to the 
traditional client-server computing model. No single search engine or portal can locate 
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and catalog the ever-increasing amount of information on the Web in a timely way. 
Moreover, a huge amount of information is transient and not subject to capture by 
techniques such as Web crawling. For example, research has estimated that the world 
produces two exabytes or about 2xl0 18 bytes of information every year, but only 
5 publishes about 300 terabytes or about 3xl0 12 bytes. In other words, for every megabyte 
of information produced, only one byte gets published. Moreover, Google claims that it 
searches about only 1.3xl0 A 8 web pages. Thus, finding useful information in real time is 
increasingly difficult. 

10 Although miles of new fiber have been installed, the new bandwidth gets little use 

if everyone goes to one site for content and to another site for auctions. Instead, hot spots 
just get hotter while cold pipes remain cold. This is partly why most people still feel the 
congestion over the Internet while a single fiber's bandwidth has increased by a factor of 
10 A 6 since 1975, doubling every 16 months. 

15 

New processors and storage devices continue to break records in speed and 
capacity, supporting more powerful end devices throughout the network. However, 
computation continues to accumulate around data centers, which have to increase their 
workloads at a crippling pace, thus putting immense pressure on space and power 
20 consumption. 

Finally, computer users in general are accustomed to computer systems that are 
deterministic and synchronous in nature, and think of such a structure as the norm. For 
example, when a browser issues a URL request for a Web page, the output is typically 
25 expected to appear shortly afterwards. It is also typically expected that everyone around 
the world will be able to retrieve the same page from the same Web server using the same 
URL. 

The term peer-to-peer networking or computing (often referred to as P2P) may be 
30 applied to a wide range of technologies that greatly increase the utilization of information, 
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bandwidth, and computing resources in the Internet. Frequently, these P2P technologies 
adopt a network-based computing style that neither excludes nor inherently depends on 
centralized control points. Apart from improving the performance of information 
discovery, content delivery, and information processing, such a style also can enhance the 
5 overall reliability and fault-tolerance of computing systems. 

Peer-to-peer (P2P) computing, embodied by applications like Napster, Gnutella, 
and Freenet, has offered a compelling and intuitive way for Internet users to find and 
share resources directly with each other, often without requiring a central authority or 
10 server. As much as these diverse applications have broken new ground, they typically 
address only a single function, run primarily only on a single platform, and are unable to 
U directly share data with other, similar applications. 

Many peer-to-peer systems are built for delivering a single type of service. For 
ffl 15 example, Napster provides music file sharing, Gnutella provides generic file sharing, and 



q AIM provides instant messaging. Given the diverse characteristics of these services and 

L the lack of a common underlying P2P infrastructure, each P2P software vendor tends to 

If* create incompatible systems — none of them able to intemperate with one another. This 

means each vendor creates its own P2P user community, duplicating efforts in creating 



20 software and system primitives commonly used by all P2P systems. Moreover, for a peer 
to participate in multiple communities organized by different P2P implementations, the 
peer must support multiple implementations, each for a distinct P2P system or 
community, and serve as the aggregation point. 

25 Many P2P systems today offer their features or services through a set of APIs that 

are delivered on a particular operating system using a specific networking protocol. For 
example, one system might offer a set of C++ APIs, with the system initially running only 
on Windows, over TCP/IP, while another system offers a combination and C and Java 
APIs, running on a variety of UNIX systems, over TCP/IP but also requiring HTTP. A 

30 P2P developer is then forced to choose which set of APIs to program to, and 
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consequently, which set of P2P customers to target. Because there is little hope that the 
two systems will interoperate, if the developer wants to offer the same service to both 
communities, they have to develop the same service twice for two P2P platforms or 
develop a bridge system between them. Both approaches are inefficient and impractical 
5 considering the dozens of P2P platforms in existence. 
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Many P2P systems, especially those being offered by upstart companies, tend to 
choose one operating system as their target deployment platform. The cited reason for this 
choice is to target the largest installed base and the fastest path to profit. The inevitable 
10 result is that many dependencies on platform-specific features are designed into (or just 
creep into) the system. This is often not the consequence of technical desire but of 
engineering reality with its tight schedules and limited resources. 



This approach is clearly shortsighted. Even though the earliest demonstration of 
p 15 P2P capabilities are on platforms in the middle of the computing hardware spectrum, it is 

m 

<;g very likely that the greatest proliferation of P2P technology will occur at the two ends of 

the spectrum — large systems in the enterprise and consumer-oriented small systems. In 
fact, betting on any particular segment of the hardware or software system is not future 
proof. 



& 20 



Figures 1A and IB are examples illustrating the peer-to-peer model. Figure 1A 
shows two peer devices 104 A and 104B that are currently connected. Either of the two 
peer devices 104 may serve as a client of or a server to the other device. Figure IB shows 
several peer devices 104 connected over the network 106 in a peer group. In the peer 
25 group, any of the peer devices 104 may serve as a client of or a server to any of the other 
devices. 



Prior art peer-to-peer systems are generally built for delivering a single type of 
service, for example a music file sharing service, a generic file sharing service, or an 
30 instant messaging service. Given the diverse characteristics of these services and given 
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the lack of a common underlying peer-to-peer infrastructure, each vendor tends to form 
various peer-to-peer "silos". In other words, the prior art peer-to-peer systems typically 
do not intemperate with each other. This means each vendor has to create its own peer-to- 
peer user community, duplicating efforts in creating primitives commonly used by peer- 
to-peer systems such as peer discovery and peer communication. 

Discovery in a peer-to-peer environment may be based on centralized discovery 
with a centralized index. This method is used by such peer-to-peer applications as 
Napster and AIM. Discovery based on a centralized index may be efficient, 
deterministic, and well suited for a static environment. Such a method of discovery may 
also provide centralized control, provide a central point of failure, and provide easy denial 
of services. However, such a method of discovery may be expensive to scale and may 
degrade with aging. 

Discovery in a peer-to-peer environment may also be based on net crawling. This 
method is used by such peer-to-peer applications as Gnutella and FreeNet. Discovery 
based on net crawling may be simple, adaptive, deterministic, inexpensive to scale, well 
suited for a dynamic environment, and may be difficult to attack. Such a method of 
discovery may also improve with aging. However, such a method of discovery may 
provide slower discovery than centralized control. 

In a peer-to-peer environment, assume there is a peer-to-peer community offering 
a search capability for its members, where one member can post a query and other 
members can hear and respond to the query. One member is a Napster user and has 
implemented a feature so that, whenever a query is received seeking an MP3 file, this 
member will look up the Napster directory and then respond to the query with 
information returned by the Napster system. Here, a member without any knowledge of 
Napster may benefit because another member implemented a bridge to connect their peer- 
to-peer system to Napster. This type of bridging is very useful, but when the number of 
services is large, pair-wise bridging becomes more difficult and undesirable. Thus, it may 
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be desirable to provide a platform bridge that may be used to connect various peer-to-peer 
systems together. 



In another example, one engineering group requires a sizable storage capability, 
5 but also with redundancy to protect data from sudden loss. A common solution is to 
purchase a storage system with a large capacity and mirrored disks. Another engineering 
group later decides to purchase the same system. Both groups end up with a lot of extra 
capacity, and have to pay higher prices for the mirroring feature. Thus, it may be desirable 
to provide a mechanism by which each group may buy a simple storage system without 
10 the mirroring feature, where the disks can then discover each other automatically, form a 
storage peer group, and offer mirroring facilities using their spare capacity. 

As yet another example, many devices such as cell phones, pagers, wireless email 
devices, Personal Digital Assistants (PDAs), and Personal Computers (PCs) may carry 

15 directory and calendar information. Currently, synchronization among the directory and 
calendar information on these devices is very tedious, if not impossible. Often, a PC 
becomes the central synchronization point, where every other device has to figure out a 
way to connect to the PC (using serial port, parallel port, IrDA, or other method) and the 
PC must have the device driver for every device that wishes to connect. Thus, it may be 

20 desirable to provide a mechanism by which these devices may interact with each other, 
without extra networking interfaces except those needed by the devices themselves, 
utilizing a common layer of communication and data exchange. 

Reliable delivery of data on a network may include the notion of guaranteed 
25 delivery (barring a connection drop or major network, hardware, and/or software failure) 
and ordering of the data. Some connections between peers in a peer-to-peer environment 
may provide unidirectional, asynchronous delivery of data. Such connections, however, 
typically do not provide reliable delivery of the data. Some connections between peers in 
a peer-to-peer environment may be implemented over network connections using a 
30 network protocol that provides reliable delivery of data packets (e.g. TCP/IP). However, 
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such network protocols typically only provides reliable delivery on a direct connection 
between two nodes; if there are one or more hops on the network connection between the 
two peer nodes, then delivery of data may not be reliable. In addition, connections 
between peers may pass through one or more firewalls and/or gateways, further hindering 
reliable delivery of data. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1A illustrates a prior art example of two devices that are currently 
5 connected as peers; 

Figure IB illustrates a prior art example of several peer devices connected over 
the network in a peer group; 

10 Figure 2 illustrates one embodiment of peer-to-peer platform software architecture 

at the conceptual level; 

M 

Q Figure 3 illustrates an exemplary content identifier according to one embodiment; 
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15 Figure 4 illustrates a point-to-point pipe connection between peers according to 



20 



Figure 5 illustrates a peer-to-peer platform message format according to one 
embodiment; 

Figure 6 illustrates the content of a peer advertisement according to one 
embodiment; 



Figure 7 illustrates the content of a peer group advertisement according to one 
25 embodiment. 

Figure 8 illustrates the content of a pipe advertisement according to one 
embodiment; 

Figure 9 illustrates the content of a service advertisement according to one 
30 embodiment; 
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Figure 10 illustrates the content of a content advertisement according to one 
embodiment; 

Figure 11 illustrates the content of an endpoint advertisement according to one 
embodiment; 

Figure 12 illustrates protocols and bindings in a peer-to-peer platform according to 
one embodiment; 

Figure 13 illustrates discovery through a rendezvous proxy according to one 
embodiment; 

Figure 14 illustrates discovery through propagate proxies according to one 
embodiment; 

Figure 15 illustrates using messages to discover advertisements according to one 
embodiment; 

Figure 16 illustrates one embodiment of using peer resolver protocol messages 
between a requesting peer and a responding peer; 

Figure 17 illustrates one embodiment of using peer information protocol messages 
between a requesting peer and a responding peer; 

Figure 18 illustrates several core components and how they interact for discovery 
and routing according to one embodiment; 

Figure 19 illustrates one embodiment of message routing in a peer-to-peer 
network that uses the peer-to-peer platform; 
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Figure 20 illustrates traversing a firewall in a virtual private network when access 
is initiated from outside only according to one embodiment; 

Figure 21 illustrates email exchange through an email gateway according to one 
embodiment; 

Figure 22 illustrates traversing a firewall when access is initiated from the inside 
according to one embodiment; 

Figure 23 illustrates embodiments of a peer-to-peer platform proxy service, and 
shows various aspects of the operation of the proxy service; 

Figure 24 illustrates a method of using a proxy service for peer group registration 
according to one embodiment; 

Figure 25 illustrates peer group registration across a firewall according to one 
embodiment; 

Figure 26 illustrates a method of providing peer group membership through a 
proxy service according to one embodiment; 

Figures 27A and 27B illustrate a method of providing privacy in the peer-to-peer 
platform according to one embodiment; 

Figures 28A and 28B illustrate one embodiment of a method for using a peer-to- 
peer platform proxy service as a certificate authority; 

Figure 29 illustrates a pipe between peer nodes passing through an intermediary 
peer node according to one embodiment; 
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Figure 30 illustrates a pipe service that may manage and create pipe connections 
among peers according to one embodiment; 



Figure 31 is a flowchart illustrating a method for creating a connection between 
5 peers in a peer-to-peer networking environment according to one embodiment; 

Figure 32 is a flowchart illustrating a method for creating a connection between 
peers in a peer-to-peer networking environment using a pipe service according to one 
embodiment; 

10 

Figures 33A and 33B illustrate two exemplary peers implementing a reliable 
j, 4, communications channel over a pipe according to one embodiment; 

III Figures 34A-34E illustrate operations of a transmit window and a receive window 

m. 15 according to one embodiment; and 

I 

11 Figures 35A-35D are flowcharts illustrating a method for providing a reliable 

|*& connection between peers in a peer-to-peer networking environment according to one 



*3 20 



embodiment. 



While the invention is described herein by way of example for several 
embodiments and illustrative drawings, those skilled in the art will recognize that the 

25 invention is not limited to the embodiments or drawings described. It should be 
understood, that the drawings and detailed description thereto are not intended to limit the 
invention to the particular form disclosed, but on the contrary, the intention is to cover all 
modifications, equivalents and alternatives falling within the spirit and scope of the 
present invention as defined by the appended claims. The headings used herein are for 

30 organizational purposes only and are not meant to be used to limit the scope of the 
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description or the claims. As used throughout this application, the word "may" is used in 
a permissive sense (i.e., meaning having the potential to), rather than the mandatory sense 
(i.e., meaning must). Similarly, the words "include", "including", and "includes" mean 
including, but not limited to. 
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SUMMARY OF THE INVENTION 



Embodiments of a system and method for establishing reliable connections 
between peers in a peer-to-peer networking environment are described. In one 
5 embodiment, a communications channel may be established between peers in a peer-to- 
peer environment. In one embodiment, the communications channel may be established 
over a pipe. In one embodiment, the communications channel may be established on a 
unidirectional, asynchronous connection. In one embodiment, the communications 
channel may be established on a bi-directional, synchronous connection. One of the peers 
10 may generate messages to send to the other peer. The source peer may buffer the 
generated messages until a transmit window of N messages have been buffered, where N 
! ? £ is a positive integer. The source peer may then transmit the window of N messages over 

f| the communications channel to the destination peer. The source peer may continue to 

ti generate messages. The destination peer may receive the window of N transmitted 

m 

j!jf| 15 messages on the communications channel. In one embodiment, the messages may be 
received in arbitrary order. After receiving a receive window of M messages, the 
destination peer may send an acknowledgement to the source peer that the M messages 
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* have been received, where M is a positive integer. In one embodiment, M is less than or 



equal to N. In one embodiment, M is less than N. In one embodiment, N is an even 



y 20 integer, and M = N / 2. 

ru 

In one embodiment, each message may include a sequence number configured for 
use in maintaining ordering of received messages on a receiving peer. The destination 
peer may check the sequence number of each received message and store the first M 

25 messages in the sequence of N transmitted messages in a receive window. Other received 
messages in the sequence of N transmitted messages may be buffered by the destination 
peer, or alternatively may be discarded (as the discarded messages may be retransmitted 
in the next transmit window). In one embodiment, the destination peer may monitor 
elapsed time since the receipt of a first of the N transmitted messages. If a timeout limit 

30 is exceeded before the first M messages in the sequence of N transmitted messages is 
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received, the destination peer may send an acknowledgement to peer indicating the last 
(e.g. highest sequence number) of a continuous sequence of messages (starting at the 
lowest sequence number) received and buffered in receive window. If the destination peer 
receives more than M messages, or alternatively one or more messages above the Mth 
message in the sequence of transmitted messages, the messages may be buffered and, 
after acknowledging and/or processing the messages in receive window, one or more of 
the buffered messages may be moved into the receive buffer. Alternatively, the receive 
buffer may be shifted on a buffer of received messages and may include one or more, if 
any, previously received messages. 

After receiving the acknowledgement, the source peer may shift the window by 
the actual number of messages received by the destination peer as indicated in the 
acknowledgement, and may then transmit any messages in the transmit window to the 
destination peer over the communications channel. In one embodiment, there may be less 
than or equal to N messages in the transmit window when the messages are transmitted. 
Note that, if M is less than N, then one or more messages that were previously transmitted 
may be retransmitted. If the destination peer receives retransmitted messages that it has 
previously received and buffered, it may discard the duplicate received messages, or 
alternatively may overwrite the previously received copies of the messages. 

In one embodiment, a destination peer may request retransmission of messages. 
The request for retransmission may specify one or more previously received messages. 
Alternatively, the request for retransmission may specify one or more messages that have 
not been received. In one embodiment, the request for retransmission may include one or 
more sequence numbers, or alternatively a range of sequence numbers, of messages 
requested for retransmission. In one embodiment, the request for retransmission may be a 
message formatted in accordance with a peer-to-peer platform protocol, such as the pipe 
binding protocol or endpoint routing protocol. 

A communications channel may make multiple hops on a network. In one 
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embodiment, different hops in the connection may use different underlying network 
protocols. Communications channel may also pass through one or more firewalls and/or 
one or more gateways on the network. A communications channel may also pass through 
one or more router (relay) peers on the network. In one embodiment, the relay peers may 
simply receive messages and forward the messages. In this embodiment, the relay peers 
may not acknowledge received and/or transmitted messages, and/or may not maintain 
sequencing of the messages. Thus, the mechanism for reliable connections may provide 
reliable delivery of messages over a network connection regardless of the implementation 
of that connection (multiple hops, firewalls, gateways, relay peers, etc.). 

In one embodiment, other peer nodes may connect to the communications 
channel, receive messages from the source peer node over the communications channel/ 
transmit acknowledgements that one or more of the transmitted messages have been 
received, and the peer node may then retransmit messages not acknowledged as received 
by the other peer nodes on the communications channel. 

In one embodiment, the destination peer may also transmit messages to the source 
peer over the same communication channel using the same or similar method as 
described herein to thus provide reliable bi-directional message deliver over the 
communications channel. In one embodiment, a different communication channel may 
be established between the two peers to and the same or similar method as described 
herein may be used on the different communications channel to thus provide reliable bi- 
directional message delivery. 

In one embodiment, the peers may monitor and evaluate the reliability of message 
delivery over the communications channel and may dynamically adjust the sizes of the 
transmit window and the receive window based upon evaluation of the reliability. 

In one embodiment, establishing, operating, maintaining, and monitoring the 
reliable communications channel, including the transmit and receive windows and the 
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transmission, reception, and acknowledgement of received messages may be performed 
by a pipe service. In one embodiment, each peer coupled to the reliable communications 
channel may include an instance of the pipe service. 
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DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 



Embodiments of an open network computing platform designed for peer-to-peer 
computing are described. The network computing platform may be referred to as a peer- 

5 to-peer platform. The peer-to-peer platform may be used to build a wide range of 
distributed services and applications in which every device is addressable as a peer, and 
where peers can bridge from one domain into another. The peer-to-peer platform may 
enable developers to focus on their own application development while easily creating 
distributed computing software that is flexible, interoperable, and available on any peer 

10 on the expanded Web. The peer-to-peer platform may enable software developers to 
deploy interoperable services and content, further spring-boarding the peer-to-peer 
revolution on the Internet. The peer-to-peer platform addresses the problems of prior art 
peer-to-peer systems by providing a generic and service-agnostic peer-to-peer platform 
that may be preferably defined by a small number of protocols. Each protocol is 

15 preferably easy to implement and easy to be adopted into peer-to-peer services and 
applications. Thus, service offerings from one vendor may be used, perhaps transparently, 
by the user community of another vendor's system. 

The peer-to-peer platform extends P2P computing to enable a wide range of 
distributed computing applications and overcome the limitations typically found in prior 
art P2P applications. The peer-to-peer platform is a network computing technology that 
provides a set of simple, small, and flexible mechanisms that can support P2P computing 
on any platform, anywhere, and at any time. The peer-to-peer platform generalizes P2P 
functionality and provides core technology that addresses the limitations of prior art P2P 
computing technologies. 

The peer-to-peer platform is a modular platform that provides simple and essential 
building blocks for developing a wide range of distributed services and applications. The 
peer-to-peer platform specifies a set of protocols rather than an API. Thus, the peer-to- 
30 peer platform can be implemented in any language on any Operating System to provide 



20 
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solutions ranging from providing a simple protocol-based wrapper that enables a small 
device to join a network of peers to developing a fully integrated application that supports 
metering, monitoring, high-level security and communication across server-class systems. 

In one embodiment, the peer-to-peer platform architecture may include, but is not 
limited to, protocols, advertisements, and core services. Network protocol bindings may 
be used to preferably ensure interoperability with existing content transfer protocols, 
network transports, routers, and firewalls. The peer-to-peer platform may be used to 
combine network nodes (peers) into a simple and coherent peer-to-peer network 
computing platform. The platform is preferably directed at providing several benefits 
including, but not limited to, no single point of failure, asynchronous messaging, the 
ability for peers to adapt to their network environment, and moving content towards its 
consumers. 

Figure 2 illustrates one embodiment of peer-to-peer platform software architecture 
at the conceptual level. The peer-to-peer platform may include several layers. In one 
embodiment, the software stack may be described using three layers; a peer-to-peer 
platform (core) layer 120, a service layer 140 and an application layer 150. In one 
embodiment, the peer-to-peer platform may include a core layer 120 that defines and 
encapsulates minimal primitives that are common to peer-to-peer networking, including, 
but not limited to, peers 110, peer groups 122, peer discovery 124, peer communication 
(e.g. pipes) 126, peer monitoring 128, and associated security primitives 130. This layer 
may be shared by all peer-to-peer devices so that interoperability becomes possible. 

A peer may be defined as any entity that runs some or all of one or more protocols 
provided by the peer-to-peer platform core layer. As such, a peer may manifest in the 
form of a processor, a process or a device. A peer may be anything with a digital 
heartbeat that supports the peer-to-peer platform core, including sensors, servers, PCs, 
computers up to and including supercomputers, PDAs, manufacturing and medical 
equipment, phones and cellular phones. In order to interact with other peers (e.g. to form 
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or join peer groups), the peer needs to be connected to some kind of network (wired or 
wireless), such as IP, Bluetooth, or Havi, among others. 

The peer-to-peer platform may provide mechanisms through which peers may 
discover each other, communicate with each other, and cooperate with each other to form 
peer groups. Peers may discover each other on the network to form transient or persistent 
relationships called peer groups. A peer group is a collection of peers connected by a 
network that share a common set of interests and that have agreed upon a common set of 
rules to publish, share and access any computer content (code, data, applications, or other 
collections of computer representable resources), and communicate among themselves. 
Peer groups may also be statically predefined. The peers in a peer group may cooperate 
to provide a common set of services. A peer group may be viewed as an abstract region 
of the network, and may act as a virtual subnet. The concept of a region virtualizes the 
notion of routers and firewalls, subdividing the network in a self-organizing fashion 
without respect to actual physical network boundaries. In one embodiment, peer groups 
implicitly define a region scope that may limit peer propagation requests. Conceptually, a 
peer group may be viewed as a virtual entity that speaks the set of peer group protocols. 

A peer group may theoretically be as large as the entire connected universe. 
Naming anything uniquely is a challenge in such a large namespace. In one embodiment, 
the peer-to-peer platform may support and/or provide sophisticated naming and binding 
services, hi one embodiment, the peer-to-peer platform may use a universal unique 
identifier (UUID), for example, a 64- or 128-bit datum, to refer to an entity (e.g. a peer, 
peer group, pipe, content, etc.). For example, UUIDs may be embedded in advertisements 
for internal use. UUIDs preferably may be used to guarantee that each entity has a unique 
UUID within a local runtime environment and serves as a canonical way of referring to an 
entity, but because a global state is not assumed, it may not be possible to provide a 
guarantee of uniqueness across an entire community that may consist of millions of peers. 
This may not be a problem because a UUID may be used within the peer-to-peer platform 
as an internal identifier. This may become significant only after the UUID is securely 
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bound to other information such as a name and a network address. In one embodiment, 
Uniform Resource Name (URN) format may be used for the expression of UUIDs. 

The core layer 120 provides core support for peer-to-peer services and 
applications. In a multi-platform, secure execution environment, the core mechanisms of 
peer groups, peer pipes and peer monitoring may be provided. Peer groups 122 may 
establish a set of peers and naming within a peer group with mechanisms to create 
policies for creation and deletion, membership, advertising and discovery of other peer 
groups and peer nodes, communication, security, and content sharing. Pipes provide 
virtual communication channels among peers. Messages sent in pipes may support 
transfer of data, content, and code in a protocol-independent manner, allowing a range of 
security, integrity, and privacy options. In one embodiment, messages may be structured 
with a markup language such as XML. Peer monitoring 128 enables control of the 
behavior and activity of peers in a peer group and can be used to implement peer 
management functions including access control, priority setting, traffic metering, and 
bandwidth balancing. 

The core layer 120 may include protocols and building blocks to enable key 
mechanisms for peer to peer networking, including discovery, transport (including 
firewall handling and limited security), and the creation of peers and peer groups. The 
core layer 120 is preferably thin and small, and preferably provides interesting and 
powerful primitives for use by services and applications in the other layers. The core layer 
120 may support choices such as anonymous vs. registered users and encrypted vs. clear 
text content without imposing specific policies on developers. Policy choices may be 
made, or when necessary, implemented, at the service layer 140 and/or application layer 
150. For example, administration services such as accepting or rejecting a peer's 
membership in a peer group may be implemented using the functionality provided by the 
core layer 120. 
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The core components of the peer-to-peer protocol may be used to implement 
discovery mechanisms for searching, publishing and recovering of core abstractions (e.g. 
peers, peer group, pipes, endpoints, and advertisements). These mechanisms are 
preferably simple, administration free, and do not require special peers to act as "master" 
peers. These mechanisms may allow processes in the peer-to-peer network, in absence 
of help from other applications and/or services, to bootstrap and find out the information 
necessary to access applications and services that can help. Also, the core may "return" to 
this standalone behavior and still function if helper applications or services fail. In one 
embodiment, safety mechanisms may be put in place in order to avoid a major overflow 
of "web-crawling". In one embodiment, applications and/or services that support the 
peer-to-peer protocol may access, control, and/or override the core components, even to 
the extreme of implementing a centralized, client-server model based on the core 
components. 

At the highest abstraction level, the peer-to-peer platform may be viewed as a set 
of protocols provided at the core layer 120. In one embodiment, a common thread among 
peer-to-peer platform peers is protocols, not APIs or software implementations. The peer- 
to-peer platform protocols preferably guarantee interoperability between compliant 
software components executing on potentially heterogeneous peer runtimes. Thus the 
peer-to-peer platform is preferably agnostic to programming languages. The term 
compliant may refer to a single protocol only. That is some peers may not implement all 
the core protocols. Furthermore, some peers may only use a portion (client-side or server- 
side only) of a protocol. 

Each protocol may be defined by one or more messages exchanged among 
participants of the protocol. Each message may have a predefined format, and may 
include various data fields. In one embodiment the protocols may utilize messaging such 
as XML messages. The peer-to-peer platform connects peer nodes with each other. The 
peer-to-peer platform is preferably platform-independent by virtue of being a set of 
protocols. As such, the peer-to-peer platform may not require APIs and remains 
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independent of programming languages, so that it can be implemented in C/C++, Java, 
Java 2ME, Perl, Python or other languages. This means heterogeneous devices with 
completely different software stacks can preferably interoperate through the peer-to-peer 
platform protocols. To underpin this set of protocols, the peer-to-peer platform may 
5 define a number of concepts including peer, peer group, advertisement, message, pipe, 
and more. 



Q 
in 



m 



In one embodiment, peer-to-peer protocols may be embodied as markup language 
(e.g. XML) messages that may be sent between two peers. In one embodiment, the peer- 

10 to-peer platform messages may define the protocols used to discover and connect peers 
and peer groups, and to access resources offered by peers and peer groups, among others. 
The use of markup language (e.g. XML) messages to define protocols may allow many 
different kinds of peers to participate in a protocol. Each peer may be free to implement 
the protocol in a manner best suited to its abilities and role. For example, not all peers 

15 are capable of supporting a Java runtime environment. In one embodiment, the protocol 
definition does not require nor imply the use of Java on a peer. 



<\ qS 

L$ Several peer-to-peer platform protocols that may be provided by embodiments of 

j,{f the peer-to-peer platform are described later in this document. The protocols defined in 

20 this document may be realized over networks including, but not limited to, the Internet, a 
corporate intranet, a dynamic proximity network, a home networking environment, 
LANs, and WANs. The protocols defined in this document may also be realized within a 
single computer. Thus, the peer-to-peer platform is preferably transport protocol 
independent. The size and complexity of the network peers that may support these 
25 protocols preferably includes a wide range of peer implementations including peers 
implemented on, but not limited to, simple light switches, PDAs, cell phones, pagers, 
laptop and notebook computers, smart appliances, personal computers, workstations, 
complex, highly-available servers, mainframe computers and even supercomputers. 
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The peer-to-peer platform may further include a peer-to-peer services layer 140. 
This layer may provide capabilities that may not be absolutely necessary for a peer-to- 
peer network to operate but that may be desirable to provided added functionality beyond 
the core layer 120 in the peer-to-peer environment. The service layer 140 may deal with 
5 higher-level concepts such as search and indexing, directory, storage systems, file 
sharing, distributed file systems, resource aggregation and renting, protocol translation, 
authentication and PKI (public key infrastructure) systems. These services, which may 
make use of the protocols and building blocks provided by the core layer 120, may be 
useful by themselves but also may be included as components in an overall P2P system. 
10 Thus, services may include one or more services 144 provided by the peer-to-peer 
platform. These platform-provided services 144 may include indexing, searching and file 
1 4 sharing services, for example. The services layer 140 may provide hooks for supporting 

generic services (such as searching, sharing and added security) that are used in many 
P2P applications. Thus, services may also include one or more services 142 not provided 
15 as part of the peer-to-peer platform but rather provided by the peer-to-peer platform 
community. These services 142 may be user-defined and may be provided, for example, 
to member peers in a peer group as a peer group service. 



til 
ill 



Services may expand upon the capabilities of the core layer 120 and may be used 
20 to facilitate application development. Facilities provided as services in the service layer 
140 may include mechanisms for search and indexing, directory, storage systems, file 
sharing, distributed file systems, resource aggregation and renting, protocol translation, 
authentication, PKI services, and caching code and content to enable cross-application 
bridging and translation of files, among others. Searching capabilities may include 
25 distributed, parallel searches across peer groups that are facilitated by matching an XML 
representation of a query to be processed with representations of the responses that can be 
provided by each peer. These facilities may be used for simple searches, for example 
searching a peer's repository, or more complex searches of dynamically generated content 
that is unreachable by conventional search engines. P2P searches may be conducted 
30 across a company's intranet, for example, to quickly locate relevant information within a 



Atty. Dkt No.: 5681-07400/ P7109 



23 



Conley Rose & Tayotu P.C. 



secure environment. By exercising tight control over peer group membership and 
enabling encrypted communication between peers, a company may extend this capability 
to its extranet, including business partners, consultants, and suppliers as peers. The same 
mechanisms that facilitate searches across the peer group may be used as a bridge to 
incorporate Internet search results, and to include data outside of the peer's own 
repository, for example searching a peer's disk. The peer services layer 140 may be used 
to support other custom, application-specific functions. For example, a secure peer 
messaging system may be built to allow anonymous authorship and a persistent message 
store. The peer services layer 140 provides the mechanisms to create such secure tools; 
the application developers themselves may determine specific tool policies. 

The peer-to-peer platform may also include a peer-to-peer application layer 150. 
The application layer 140 may support the implementation of integrated applications such 
as file sharing, resource sharing, monetary systems, distributed storage, peer-to-peer 
instant messaging, entertainment, content management and delivery, peer-to-peer email 
systems, distributed auction systems, among others. Applications may be "vertical" or 
they may be developed to intemperate with other distributed applications. One or more 
applications 154 may be provided as part of the peer-to-peer platform. For example, one 
embodiment of the peer-to-peer platform may include a shell application 160 as a 
development environment built on top of the platform. The shell application may provide 
interactive access to the peer-to-peer platform via a simple command line interface 162. 

Applications may also include community applications 152 not provided by the 
peer-to-peer platform. These community applications 152 may be user-defined and may 
be provided, for example, to member peers in a peer group as a peer group application. 

In one embodiment, the boundary between services and applications is not rigid. 
An application to one customer can be viewed as a service to another customer. An 
application may use services. Services may serve as protocols that may be shared among 
various applications. An application may provide a user interface, a way to define a set of 
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files to share, a way to initiate a search, a way to display the results, and a way to initiate 
a file transfer, for example. Such an application may make use of a set of services, for 
example a reliable point-to-point file transfer service, a distributed search service, and a 
discovery service to locate other peers, among others. 

5 

Applications may be built using peer services as well as the core layer 120. The 
peer-to-peer platform may support the fundamental levels broadly, and rely on the P2P 
development community to provide additional peer services and applications. Peer 
applications enabled by both the core layer 120 and peer services layer 140 may include 

10 P2P auctions that link buyers and sellers directly, with buyers able to program their 
bidding strategies using a simple scripting language, for example. Resource-sharing 
applications, such as SETI@home, may be built more quickly and easily, with 
heterogeneous, worldwide peer groups supported from day one. Instant messaging, mail, 
and calendaring services may facilitate communication and collaboration within peer 

15 groups that are secure and independent of service provider-hosted facilities. Virtually any 
other type of application may be build on top of the core layer 120 and services layer 140. 



|- ^ Some features, such as security, may manifest in all three layers and throughout a 

P2P system, albeit in different forms according to the location in the software 



20 architecture. The system is preferably modular, and allows developers to pick and 
choose a collection of services and applications that suits their needs. 



A typical peer-to-peer platform network may provide an inherently 
nondeterministic topology/response structure. In a peer-to-peer platform network, a 

25 specific resource request may not return for minutes, hours, or even days; in fact, it may 
never return at all. In addition, people from different parts of the world requesting the 
same resource are likely to get different copies of the resource from completely different 
locations. Peers may obtain content from multiple servers, ideally reaching a nearby one 
that is up and running. The original source peer need not service every resource request; 

30 in fact, it does not even have to be up and running. The nondeterministic structure may 
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also help provide the optimized use of network bandwidth. The concentrated localized 
traffic congestion typical of today's Web doesn't affect P2P networking. The 
nondeterministic structure may also help provide a lowered cost of content distribution. 
The P2P network can absorb contents and replicate it for easy access. The 

5 nondeterministic structure may also help provide leveraged computing power from every 
node in the network. With asynchronous operations, a user may issue many requests for 
many resources or services simultaneously and have the network do the work. The 
nondeterministic structure may also help provide unlimited scalability. A properly 
designed P2P application may span the entire known connected universe without hitting 

10 scalability limits; this is typically not possible with centralized schemes. Note, however, 
that the peer-to-peer platform also may support deterministic, synchronous applications. 



As an example of a nondeterministic, asynchronous application, consider a 
II network-based music request service that operates over a peer-to-peer platform-based 

in 

|jp 15 P2P network. A peer submits multiple requests for music files and then checks back later 

;;| to see if the music request service in the peer group has found them. A few requested files 

s have been found, but others cannot be located. The service's response in regards to the 

fa files that cannot be located may be something like "Music selection and availability 

hi a 

changes continuously; please retry your request later." This is an acceptable 



20 nondeterministic outcome. Even though the service couldn't find a file, the same file may 
be available later if the same request is resubmitted, because peers that host the desired 
files may have come online in the meantime. 



The peer-to-peer platform provides the ability to replicate information toward end 
25 users. Popular content tends to be replicated more often, making it easier to find as more 
copies are available. Peers do not have to always go back to the same peer to obtain the 
information they want, as is typical in the client/server model. Peers may obtain 
information from neighboring peers that have already cached the information. Each peer 
may become a provider to all other peers. 

30 
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In one embodiment the peer-to-peer platform may enable peers to find content that 
is closest to them. This content may include data (e.g. files) or even services and 
applications. For example, if a peer node in an office peer-to-peer network using the 
peer-to-peer platform is moved, the peer-to-peer platform may allow the peer to 
automatically locate content (e.g. using a discovery service that participates in the 
discovery protocol) including services (e.g. a printer service and an email service) hosted 
by other peers closest to the peer's new location, without requiring any manual 
reconfiguration. Further, at least some content may be copied or moved to the peer in its 
new location and/or to other peers proximate to the new location. 



In one embodiment, the UUIDs may be used in providing flexible configuration 
and seamless relocation of peer nodes on a peer-to-peer network, and may assist in 
locating and accessing content including services nearest to a peer node when the peer 
node is moved. For example, a businessperson based in New York may participate in a 
15 peer-to-peer network based on the peer-to-peer protocols using a notebook computer or 
other portable computing device connected to a LAN as a peer node. The businessperson 
may access an instance of an email and/or other services locally hosted by other peer 
nodes in a peer group on the LAN. If the businessperson travels to Paris, for example, 
and takes the notebook computer, the notebook computer may be connected to a different 
r| 20 LAN at the Paris location and participate in the peer-to-peer network. Because the peer 
node has a unique identifier in the peer-to-peer network (the UUID) rather than just a 
static network address, the peer node may seamlessly access instances of an email service 
and other services locally hosted on the LAN, or alternatively hosted on a peer node at the 
peer node's original location or elsewhere, using the UUID to establish its identity. The 
25 peer node may rejoin the peer group in New York to access one or more instances of 
services and other content hosted on the peer group, and may also join a peer group at the 
Paris location to access one or more other instances of services and content. Thus, the 
peer-to-peer protocols and UUIDs may provide the ability for peer nodes to move to 
different peer groups and/or peer regions and access services and other content 
30 independent of network addresses and without requiring reconfiguration of the peer node. 
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For example, when the exemplary peer node moves to Paris, connects to the network (at a 
different network address) and accesses an instance of an email service (either locally or 
remotely hosted, for example in the New York peer group), the email service may identify 
the peer node by its unique identifier and route the peer's email to the peer node at the 
new network address without requiring reconfiguration of the peer node. Thus, peer 
nodes may be relocated and access services and other content that are locally hosted or 
services and other content hosted in their original peer group if the services and other 
content are not required to be locally hosted. 

The peer-to-peer platform preferably provides a decentralized environment that 
minimizes single points of failure and is not dependent on any centralized services. Both 
centralized and decentralized services may be developed on top of the peer-to-peer 
platform. With the addition of each new network peer, the network platform preferably 
becomes more robust as it expands. In the environment, services may be implemented to 
interoperate with other services giving rise to new P2P applications. For example, a P2P 
communications service like instant messaging may easily be added to a resource-sharing 
P2P application if both support at least the necessary peer-to-peer platform protocols. 

The peer-to-peer platform may provide interoperability. The peer-to-peer platform 
may be used by developers independent of preferred programming languages, 
development environments, or deployment platforms. Embodiments of the peer-to-peer 
platform may enable interconnected peers to easily locate each other, communicate with 
each other, participate in community-based activities, and offer services to each other 
seamlessly across different P2P systems and different communities. The peer-to-peer 
platform may also provide platform independence. Embodiments of the peer-to-peer 
platform may be independent of programming languages (such as C/C++, Java, Perl, and 
KVM), system platforms (such as the Microsoft Windows, UNIX®, Solaris, Linux and 
Macintosh platforms), and networking platforms (such as TCP/IP, Bluetooth and Havi). 
Thus, heterogeneous devices with completely different software stacks may interoperate 
through the peer-to-peer platform protocols. Embodiments of the peer-to-peer platform 
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may be implementable on any device with a digital heartbeat, including, but not limited 
to, sensors, consumer electronics, Personal Digital Assistants (PDAs), appliances, 
network routers, desktop computers, data-center servers, and storage systems. 
Embodiments of the peer-to-peer platform may enable peers, independent of software and 
hardware platform, to benefit and profit from being connected to millions of other peers. 

In one embodiment, the peer-to-peer platform may run on any of various operating 
systems including embedded operating systems (with the appropriate level of Java 
runtime support, if required) such as Windows95, 98, 2000, ME, and NT, Solaris, Unix, 
Macintosh, Linux, Java 2 Platform, Micro Edition (J2ME) and 
PersonalJava Technology. The peer-to-peer platform may be implemented in any of a 
variety of development environments using any of a variety of programming languages, 
or combinations of programming languages, including, but not limited to, Java, Java 
2ME, C/C++, Perl, Python and KVM. In one embodiment, the peer-to-peer platform may 
be implemented in Java. In one embodiment, a peer-to-peer platform may be 
implemented in C/C++ on some devices, for example, to support devices without Java 
support. In one embodiment, a peer-to-peer platform may be implemented in KVM on 
some devices, for example, so that all KVM capable devices such as PDAs and cell 
phones can be peer-to-peer platform peers. Programming languages other than those 
listed may also be used in various embodiments. 

A minimal device with the ability to generate a text string may theoretically 
participate in a peer-to-peer platform network (though not necessarily in every P2P 
application). The simplistic device may need a surrogate peer on the P2P network. This 
surrogate peer may perform discovery, advertisement, and communications on behalf of 
the simplistic device (or many simplistic devices). The location of the surrogate may be 
hard-wired into the simplistic device. In this way, the simplistic device with the help of 
the surrogate can be a full-fledged peer on the peer-to-peer platform network. For 
example, a GPS locator, strapped to a sea turtle and sending out peer-to-peer platform 
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messages wirelessly with location information, may become a peer on a peer-to-peer 
platform network. 

The peer-to-peer platform is preferably independent of transport protocols. For 
example, the peer-to-peer platform may be implemented on top of TCP/IP, HTTP, 
Bluetooth, HomePNA, and other protocols. Thus, a system built on top of the peer-to- 
peer platform preferably functions in the same or similar fashion when the system is 
expanded to a new networking environment or to a new class of devices, as long as there 
is a correct transport protocol handler for the new networking protocol. 

In one embodiment, the peer-to-peer platform may use XML as the encoding 
format. XML may provide convenience in parsing and extensibility. Other embodiments 
of the peer-to-peer platform may use other encoding formats. The use of XML does not 
imply that all peer-to-peer platform peer nodes must be able to parse and to create XML 
documents. For example, a cell phone with limited resources may be programmed to 
recognize and to create certain canned XML messages and can still participate in a peer- 
to-peer platform network of peers. In one embodiment, a lightweight XML parser may be 
used that supports a subset of XML. This may help reduce the size of the peer-to-peer 
platform. 

There may be areas in a peer-to-peer environment where there is not one correct 
way to do something or where what should be done depends on the nature and context of 
the overriding application. For example, in the area of security, every P2P application 
may choose a different authentication scheme, a different way to ensure communication 
security, a different encryption algorithm for data security, a different signature scheme 
for authenticity, and a different access control policy. Therefore, for these areas, the peer- 
to-peer platform may preferably focus on mechanisms instead of policy, so that 
application developers can have the maximum freedom to innovate and offer competitive 
solutions. 
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Implementations of the peer-to-peer platform may be illustrated with a few 
application or usage scenarios. For example, assume there is a peer-to-peer community 
offering a search capability for its members, where one member can post a query and 
other members can hear and respond to the query. One member is a Napster user and has 

5 implemented a feature so that, whenever a query is received seeking an MP3 file, this 
member will look up the Napster directory and then respond to the query with 
information returned by the Napster system. Here, a member without any knowledge of 
Napster may benefit because another member implemented a bridge to connect their peer- 
to-peer system to Napster. The peer-to-peer platform may provide a platform bridge that 

10 may be used to connect the various peer-to-peer systems together. 

In another example, one engineering group requires a sizable storage capability, 
but also with redundancy to protect data from sudden loss. Using the peer-to-peer 
platform, each group may buy a simple storage system without a mirroring feature, where 
15 the disks can then discover each other automatically, form a storage peer group, and offer 
mirroring facilities using their spare capacity. 



As yet another example, many devices such as cell phones, pagers, wireless email 
devices, Personal Digital Assistants (PDAs), and Personal Computers (PCs) may carry 
3 20 directory and calendar information. Using the peer-to-peer platform, these devices may be 
able to interact with each other, without extra networking interfaces except those needed 
by the devices themselves, using the peer-to-peer platform as the common layer of 
communication and data exchange. 



25 Peers 

Network nodes (peers) of various kinds may join the peer-to-peer networking 
platform by implementing one or more of the platform's protocols. Each peer operates 
independently and asynchronously of any other peer, providing a degree of reliability and 
30 scalability not typically found in current distributed systems. Some peers may have more 
dependencies with other peers due to special relationships (e.g. gateways or routers). In 



Atty. Dkt. No.: 5681-07400/ P7109 



31 



Conley Rose & Tayon, P.C. 



one embodiment, a peer does not need to understand all of the protocols of the peer-to- 
peer platform. The peer can still perform at a reduced level if it does not support one or 
more of the protocols. 

Peers may publish and provide network resources (e.g. CPU, storage and routing 
resources) that may be used by other peers. Peers typically interact with a small number 
of other peers (network neighbors or buddy peers). Peers that provide the same set of 
services tend to be inter-changeable. Thus, it may not matter which peers a peer interacts 
with. Generally, assumptions should not be made about peer reliability or connectivity, as 
a peer may appear or leave the network at any time. Peers may have persistent storage. A 
peer may optionally cache information. 

Peers may have multiple network interfaces, though preferably a peer does not 
need to publish all of its interfaces for use with the peer-to-peer protocols. Each published 
interface may be advertised as a peer endpoint. In one embodiment, a peer endpoint is an 
identifier (e.g. a URN or URI) that uniquely identifies a peer network interface. Peer 
endpoints may be used by peers to establish direct point-to-point connection between two 
peers. Peers may not have direct point-to-point network connection between themselves, 
either due to lack of physical network connections, or network configuration (NATs, 
firewalls, proxies, etc.), and thus a peer may have to use one or more intermediary peers 
to route a message from an endpoint to another peer endpoint. 

The term rendezvous peer may be used to designate a peer that is designated to be 
a rendezvous point for discovering information about other peers, peer groups, services 
and pipes. Rendezvous peers preferably cache information that may be useful to peers 
including new peers. Rendezvous peers may provide an efficient mechanism for peers 
that are far away to find (e.g. discover) each other. Rendezvous peers may make peer 
discovery more practical and efficient. Preferably, a peer group is not required to have a 
rendezvous peer. In one embodiment, any or even all members of a peer group may 
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become rendezvous peers in a peer group. In one embodiment, each peer group may have 
different policies to authorize a peer to become a rendezvous peer. 

The term router peer may be used to describe a peer that crosses one or more 
regions and that is designated to be a router between the regions. Router peers may be 
used to route messages between different network protocols (e.g. TCP/IP, IrDA) or to 
peers that are behind firewalls. In one embodiment, any or all peer members may become 
routers. In one embodiment, peer groups may have different policies to authorize a peer to 
become a router peer for other peers. A router peer may also be referred to as a relay 
peer. 

Peers may be identified by their unique identifier (UUID) rather than by a fixed 
address. When a peer boots, it attempts to contact other peers. In one embodiment, 
contacted peers may include variable-sized caches that map nearby peers' UUID to their 
current address. This allows embodiments of the peer-to-peer platform to be run over a 
dialup connection, for example. 

In one embodiment, a peer may be assigned a unique string as a name. Any 
naming scheme may be used. In one embodiment, names are not unique unless a 
coordinated naming service is used to guarantee name uniqueness. A naming service is 
typically a centralized service that guarantees the uniqueness of name and can be used to 
register name mapping. Examples of naming services are DNS and LDAP. Use of a 
naming service is preferably optional. 

Peer Groups 

Preferably, the peer-to-peer platform describes how to create and discover peer 
groups, but does not dictate when, where, or why to create a peer group, the type of the 
group, or the membership of the group. A peer group may provide a common 
membership definition. Each peer group may establish its own membership policy in a 
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range from open (any peer can join) up to highly secure and protected (a peer may join 
only if it possesses sufficient credentials). 

In one embodiment, peers wishing to join a peer group may first locate a current 
member, and then request to join the peer group. The peer-to-peer platform may define 
how to discover peer groups, e.g. using a peer discovery protocol. The application to join 
may be rejected or accepted by the collective set of current members in accordance with 
the peer group's membership policy, hi one embodiment, a peer group core membership 
service may be used to enforce a vote among one or more group members. Alternatively, 
one or more group representative member peers may be elected or appointed to accept or 
reject new membership applications. 

In one embodiment, the peer-to-peer platform is not concerned with what 
sequence of events a peer or a peer group comes into existence. Moreover, in one 
embodiment, the peer-to-peer platform does not limit how many groups a peer can belong 
to. In one embodiment, nested and/or overlapping peer groups may be formed. In one 
embodiment, there may be a special group, called the World Peer Group, which may 
include all peer-to-peer platform peers. The world peer group preferably provides the 
minimum seed for every peer to potentially find each other and form new groups. In one 
embodiment, the world peer group has an open membership policy (e.g. has a null 
membership authenticator service). Some peers inside the world peer group may not be 
able to discover or communicate with each other — e.g., they may be separated by a 
network partition. In one embodiment, participation in the World Peer Group is by 
default. 

The peer-to-peer platform may use the concept of a peer group as an implicit 
scope of all messages originated from within the group. Peer groups may serve to 
subdivide the network into abstract regions providing an implicit scoping mechanism. 
Peer groups may provide a limited scoping environment to ensure scalability. Peer groups 
may be formed and self organized based upon the mutual interest of peers. In one 
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embodiment, no particular rules are imposed on the way peer groups are formed, but 
peers with the same interests may tend to join the same peer groups. 

In one embodiment, a scope may be realized with the formation of a 
corresponding peer group. Peer group boundaries may define the search scope when 
searching for a group's content. For example, a peer in San Francisco looking to buy a 
used car is normally not interested in cars available outside of the Bay Area. In this case, 
the peer may want to multicast a message to a subset of the current worldwide peer group, 
and a subgroup may be formed especially for this purpose. In one embodiment, the 
multicast may be done without the formation of a new peer group. In one embodiment, 
all messages may carry a special scope field, which may indicate the scope for which the 
message is intended. Any peer who receives this message may propagate the message 
based on the scope indicator. Using this approach, it is preferable that a sending peer is 
bootstrapped with some well-defined scopes and also has the ability to discover 
additional scopes. 

Peer groups may also be formed based upon the proximity of the member peers. 
Proximity-based peer groups may serve to subdivide the network into abstract regions. 
Regions may serve as a placeholder for general communication and security 
configurations that deal with existing networking infrastructure, communication scopes 
and security requirements. Peer groups may provide a scoping mechanism to reduce 
traffic overload. 

Peer groups may provide a secure cooperative environment. Peer group 
boundaries permit member peers to access and publish protected contents. Peer groups 
form virtual secure regions which boundaries limit access to the peer group resources. 
Secure services may be provided to peers within a secured peer group. Their boundaries 
may or may not reflect any underlying physical network boundaries such as those 
imposed by routers and firewalls. The concept of a region may virtualize the notion of 
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routers and firewalls, subdividing the network into secure regions in a self-organizing 
fashion without respect to actual physical network boundaries. 

Peer groups may also create a monitoring environment. Peer groups may permit 
peers to monitor a set of peers for any special purpose (heartbeat, traffic introspection, 
accountability, etc.). Peer groups may also provide a controlled and self-administered 
environment. Peer groups may provide a self-organized structure that is self-managed and 
that may be locally managed. 

Peer groups using the peer-to-peer platform preferably provide several capabilities 
including, but not limited to, the ability to, find nearby peers, find named peers anywhere 
on the network, find named peer groups anywhere on the network, join and resign from a 
peer group, establish pipes between peer group members and find and exchange shared 
content. 

Content 

Peers may be grouped into peer groups to share content. A content is published 
and shared among the peer members of a peer group. In one embodiment, content may be 
shared among group members, but not between groups. In this embodiment, no single 
item of content may belong to more than one group. If the same content is published in 
two different peer groups, two different contents may be created. In one embodiment, a 
content item may be published to make the item's existence known and available to group 
members through the use of advertisements. 

An instance of content is a copy of a content. Each content copy may be replicated 
on different peers in the peer group. Each copy preferably has the same content identifier 
as well as a similar value. Replicating contents within a peer group may help any single 
item of content be more available. For example, if an item has two instances residing on 
two different peers, only one of the peers needs to be alive and respond to the content 
request. In one embodiment, the peer-to-peer platform protocols do not specify how or 
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when contents are replicated. In one embodiment, whether and how to copy an item of 
content may be a policy decision that may be encapsulated in higher-level applications 
and services, for example a content management service. 



m 
■ %s 



5 A content may be any computer content (e.g. code, data, applications, active 

content such as services, or other collection of computer-representable resources). 
Examples of content include, but are not limited to, a text file, a structured document (e.g. 
a PDF or a XML file), a Java ".jar" or loadable library, code or even an executable 
process (checkpointed state). No size limitation is assumed. Each content instance may 

10 reside on a different peer in the peer group. The instances may differ in their encoding 
type. HTML, XML and WML are examples of encoding types. Each instance may have 
the same content identifier as well as a similar set of elements and attributes, and may 
even exist on the same peer. An encoding metadata element may be used to differentiate 
instances of content. Making new instances of content on different peers may help any 

15 single item of content be more available. For example, if an item has two instances 
residing on two different peers, only one of the peers needs to be alive and respond to the 
content request. 

Items of content that represent a network service may be referred to as active 
20 content. These items may have additional core elements above and beyond the basic 
elements used for identification and advertisement. In one embodiment, active content 
items may be recognized by Multi-Purpose Internet Mail Extensions (MIME) content 
type and subtype. In one embodiment, all peer-to-peer platform active contents may have 
the same type. In one embodiment, the subtype of an active content may be defined by 
25 network service providers and may be used to imply the additional core elements 
belonging to active content documents. In one embodiment, the peer-to-peer platform 
may give latitude to service providers in this regard, yielding many service 
implementation possibilities. 



Atty. Dkt. No.: 5681-07400/ P7109 



37 



Conley Rose & Tayon, P.C. 



In one embodiment, each item of content may have a unique canonical name. 
Figure 3 illustrates an exemplary canonical content name (which may be referred to as a 
content identifier or content identifier) according to one embodiment. The unique 
identifier may include a peer group universal unique identifier (UUID) 170, and also may 
include another name 174 that may be computed, parsed, and maintained by peer group 
members. In one embodiment, the UUID may be a 128-bit field. In one embodiment, the 
name may be a byte array. In one embodiment, the particular name implementation 
within a peer group is not mandated by the peer-to-peer platform. The name may be, for 
example, a hash code, a URI, a URN, or a name generated by any suitable means of 
uniquely identifying content within a peer group. In one embodiment, a length of 
remainder field 172 may specify the length of the name field 174 for this content in this 
particular implementation. 

In one embodiment, once a content item has been published to the peer-to-peer 
network, it may not be assumed that that the content can be later retrieved from the 
network. The content may be only available from peers that are not currently reachable or 
not currently part of the network. In one embodiment, once a content item has been 
published to the peer-to-peer network, it may not be assumed that the content can be 
deleted. Replication/republication of content by peers on the network may be unrestricted 
and the content may propagate to peers that are not reachable from the publishing peer. 

Pipes 

One embodiment may provide pipes as a mechanism for establishing 
communication between peers. Pipes may provide the primary channels for 
communication among peers. Pipes may be used as communication channels for sending 
and receiving messages between services or applications over peer endpoints. A pipe 
instance is, logically speaking, a resource within a peer group. The actual implementation 
of a pipe instance is typically through a pipe service. In one embodiment, at each 
endpoint, software to send, or receive, as well as to manage optional associated pipe 
message queues is assumed, but not mandated. 
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In one embodiment, pipes are a mechanism for interacting with services on the 
peer-to-peer network. Rather than assuming a specific naming system such as DNS or a 
specific network addressing system such as IP, the peer-to-peer platform may abstract 
these concepts via several mechanisms. Pipes provide a virtual abstraction of the network 
service using a pipe identifier which is bound to a peer identifier via a pipe advertisement, 
which in turn is bound to an endpoint address via a peer advertisement and an endpoint 
advertisement. Pipes can thus be moved from one peer to another providing flexibility in 
the way a service is deployed and consumed. The location of a machine (node) on the 
network is abstracted via the concept of the peer which binds to an endpoint. This 
provides support for dynamic movement of endpoint addresses for a specific peer. 

In one embodiment, pipes are implemented as a service on a peer. In one 
embodiment, in order for a peer to send a message to another peer's pipe, both peers must 
be part of the same peer group. This allows groups of peers to potentially implement 
different kinds of pipes, allowing for a flexible approach to communication. 

In one embodiment, to connect to a pipe, a peer may send a discovery request for 
a pipe advertisement containing specific keywords. The peer may then receive the 
requested pipe advertisement. The peer may then send a pipe resolver request for a peer 
matching the pipe identifier and may then receive the peer advertisement, for example 
from a pipe service that handles the request. The peer may then send data down the pipe, 
for example using a URL addressing scheme. 

Pipes in the peer-to-peer platform are preferably asynchronous, unidirectional, 
stateless and unreliable to provide the lowest overhead. Asynchronous pipes may enable 
developers to build large-scale interconnected distributed services and applications. Pipes 
are preferably unidirectional, and thus in one embodiment there are input pipes and 
output pipes. Pipes are preferably indiscriminate and may support binary code, data 
strings, Java technology-based objects, and/or applets, among others. The peer-to-peer 
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platform preferably does not define how the internals of a pipe work. Any number of 
unicast and multicast protocols and algorithms, and combinations thereof, may be used on 
pipes. 

Pipes may connect peers that have a direct physical link and peers that do not have 
a direct physical link. In the latter case, one or more intermediary peer endpoints may be 
used to route messages between two pipe endpoints. In one embodiment, a pipe may be a 
chain of sections, with each section of the chain using a different transport protocol. 

Figure 29 illustrates a pipe between peer nodes 200A and 200C passing through 
an intermediary peer node 200B according to one embodiment. Peers 200A and 200C 
may not have a direct physical link. Pipe segment 408A may be bound to an endpoint of 
peer 200A and to an endpoint of peer 200B. Pipe segment 408B may be bound to another 
endpoint of peer 200B and to an endpoint of peer 200C. In one embodiment, pipe 
segments 408A and 408B may use different network transport protocols. Thus, peer 
200B may act as a relay for messages sent between peers 200A and 200C on pipe 406. 
There may be more than one intermediary peer node 200 between peer nodes 200A and 
200C, and thus more than two pipe segments 408 in pipe 406. 

The pipe endpoints may be referred to as input pipes (receiving end) and output 
pipes (sending end). Pipes may provide the illusion of a virtual in and out mailbox that is 
independent of any single peer location. Services and applications may communicate 
through pipes without knowing on which physical peer a pipe endpoint is bound. When a 
message is sent into a pipe, the message is sent to all peer endpoints currently connected 
(listening) to the pipe. The set of currently connected pipe endpoints (input pipes) may be 
obtained using the pipe binding protocol. 

Unlike conventional mechanisms, peer-to-peer platform pipes may have ends that 
may be moved around and bound to different peers at different times, or not connected at 
all. In one embodiment, pipes may be virtual, in that a pipe's endpoint may be bound to 
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one or more peer endpoints. In one embodiment, pipe endpoints may be non-localized to 
a physical peer, and may be dynamically bound at creation time or runtime via the pipe 
binding protocol. The pipe binding process may include discovering and connecting the 
two or more endpoints of a pipe. 

5 

Using pipes, developers may build highly available services where pipe 
connections may be established independently of a peer location. This dynamic binding 
of pipes helps to provide redundant implementation of services over a P2P network. A 
peer may logically "pick up" a pipe at any point in time. For example, a peer that wants to 

10 use a spell checker service man connect to a peer group's spell checker pipe that is 
implemented as a redundant peer group service. The peer may be serviced as long as there 
is at least one single instance of a spell checker service still running somewhere within 
the peer group. Thus, using pipes as described herein, a collection of peers together may 
provide a high level of fault tolerance, where a new peer at a different location may 

15 replace a crashed peer, with the new peer taking over the existing pipe to keep the 
communication going. 

In one embodiment, enhanced pipes with additional properties such as reliability, 
security, and quality of service may be supported. In embodiments where the peer-to-peer 

20 platform runs on top of transports that have such properties, an implementation may 
optimize and utilize the transports. For example, when two peers communicate with each 
other and both have TCP/IP support, then an implementation may use the bidirectional 
capabilities of TCP/IP to create bidirectional pipes. Other data transfer methods that may 
be implemented by pipes as provided at the service layer to provide different quality of 

25 service include, but are not limited to: synchronous request-response (the endpoint sends 
a message, and receives a correlated answer), streaming (efficient control-flow data 
transfer) and bulk transfer (bulk reliable data transfer of binary data). 

Pipes may offer several modes of communication. Figure 4 illustrates a point-to- 
30 point pipe connection between peers 200C and 200D according to one embodiment. In 
one embodiment, a point-to-point pipe connects exactly two peer endpoints together, an 
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input pipe 202A that receives messages sent from an output pipe 204A. The pipe appears 
as an output pipe to the sender and as an input pipe to the receiver, with traffic going in 
one direction only — from the sender to the receiver. In one embodiment, no reply or 
acknowledgement operation is supported, hi one embodiment, additional information in 
the message payload (for example, a unique identifier) may be required to thread message 
sequences. The message payload may also contain a pipe advertisement that can be used 
toinstantiate or open a pipe to reply to the sender (send/response). 

Figure 4 also illustrates a propagate pipe with peer 200A as a propagation source 
and peers 200B and 200C with listening input pipes according to one embodiment. A 
propagate pipe may connect two or more peer endpoints together, from one output pipe 
204B to one or more input pipes (e.g. 202B and 202C). The result is that any message 
sent into the output pipe is sent to all input pipes. Messages flow into the input pipes 
from the output pipe (propagation source). A propagate message may be sent to all 
listening input pipes. This process may create multiple copies of the message to be sent. 
On transports that provide multicast (e.g. TCP/IP), when the propagate scope maps to 
underlying physical subnets in a one-to-one fashion, transport multicast be may used as 
an implementation for propagate. Propagate may be implemented using point-to-point 
communication on transports that do not provide multicast such as HTTP. 

Figure 30 illustrates a pipe service that may manage and create pipe connections 
among peers according to one embodiment. Peers 200A, 200B and 200C may be member 
peers in a peer group. Peer 200C may host a pipe service 400 for use by peers 200 in the 
peer group. The pipe service 400 may discover or otherwise obtain information about 
pipes 406 in the peer group and may cache information about peer endpoints 404 
currently bound to one or more pipes 406 in the peer group in a cache 402. The cached 
information 402 for each pipe may include, but is not limited to, a pipe identifier 
corresponding to the pipe, one or more peer identifiers corresponding to peers 200 with 
endpoints 404 currently bound to the pipe, and descriptive information about the 
endpoints 404. In one embodiment, the endpoints 404 described in the cached pipe 
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information are input pipes for receiving messages and other data over the pipe 406. Note 
that, in one embodiment, the pipe service 400 may be hosted by any peer in the peer 
group, including peer nodes 200A and 200C. 

Peer 200A may get a pipe advertisement for pipe 406. For example, the pipe 
advertisement may be discovered by the peer 200A through a discovery mechanism as 
described elsewhere in this document. Alternatively, the pipe advertisement may be 
included in an advertisement for a different type of peer resource (e.g. a peer 
advertisement, service advertisement, or peer group advertisement) discovered by the 
peer 200A. The pipe advertisement may include, but is not limited to, the pipe name, the 
pipe identifier, and the pipe type (e.g. reliable, unreliable, or secure). 

Peer 200A may include one or more network interfaces each supporting one or 
more network transport protocols. Peer 200A may implement one or more endpoints 404 
each corresponding to one of the network interfaces. Peer 200A may bind a particular 
endpoint 404A that corresponds to a network transport protocol compatible with the pipe 
406 to the pipe 406. Peer 200A may then communicate with pipe service 400 on peer 
200C to locate endpoints 404 bound to pipe 406. In one embodiment, peer 200A may 
broadcast a query message requesting information on endpoints 404 bound to pipe 406 in 
accordance with a pipe binding protocol. In one embodiment, the query message may 
specify a particular peer node (e.g. peer node 200C) to respond to the request. In one 
embodiment, the query message may specify a particular peer 200 (e.g. peer 200B) that 
peer 200A is interested in locating endpoints 404 for. In one embodiment, the query 
message may include the pipe advertisement. The query message may also indicate if the 
information about the pipe 406 is to be retrieved from the cached information 402 or, to 
insure the information is up-to-date, discovered by the peer service 400. 

The peer service 400 may then resolve the query by locating the requested 
information. If the query message indicates that the information about pipe 406 may be 
retrieved from cached information 402 and the cached information 402 include the 
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information about pipe 406, the peer service 400 may locate and retrieve the information 
from the cached information 402. Otherwise, the peer service 400 may discover the 
information on the network, for example by using a discovery mechanism as described 
elsewhere in this document. Cached information 402 may be updated with the newly 
discovered information for pipe 406. The peer service 400 may then send a query 
response message to peer 200A. In one embodiment, the query response message may 
include, but is not limited to a pipe identifier for pipe 406, one or more peer identifiers 
(e.g. a URI or URN) where a corresponding endpoint 404 is bound to the pipe 406, and 
an indicator of whether an endpoint 404 exists on a specified peer 200. The identified 
endpoint(s) 404 may correspond to network interface(s) on the corresponding peer 
node(s) that support the particular network transport protocol used on pipe 406. 

If pipe 406 is a unidirectional pipe, then endpoint 404A may be an output pipe on 
peer 200A for sending messages and endpoint 404B may be an input pipe on peer 200B 
for receiving messages. If pipe 406 is a point-to-point pipe, then peers 200A and 200B 
are the only peers 200 bound to the pipe 406, and messages may be sent from peer 200A 
to peer 200B (if pipe 406 is unidirectional) and vice versa (if pipe 406 is bi-directional). 
If pipe 406 is unidirectional, a second pipe connection may be established to provide bi- 
directional communications between the peer nodes 200 using a mechanism similar to 
that described above, if so desired. If pipe 406 is a propagate pipe, then one or more 
endpoints 404 on other peer nodes 200 may be bound to the pipe 406. On a point-to- 
point pipe, messages send from an output pipe are sent to all input pipes currently bound 
to the pipe. In one embodiment, endpoint 404B on peer 200B may be associated with a 
service or application hosted by peer 200B, and thus peer 200A may communicate with 
the service or application over pipe 406. Likewise, endpoint 404A on peer 200A may be 
associated with a service or application hosted by peer 200A, thus allowing the service or 
application on peer 200A to communicate with a service or application on peer 200B over 
pipe 406. 
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Figure 31 is a flowchart illustrating a method for creating a connection between 
peers in a peer-to-peer networking environment according to one embodiment. In one 
embodiment, a first peer and a second peer may be member peers in a peer group. As 
indicated at 500, the first peer may implement a pipe. The peer may bind an endpoint to 
the pipe. In one embodiment, the peer may generate and publish a pipe advertisement for 
the pipe as indicated at 502. The endpoint may be associated with a service or application 
hosted by the first peer. The pipe advertisement may be included in a resource 
advertisement such as a peer advertisement for the first peer, peer group advertisements 
for one or more peer groups that the first peer is a member peer of, and/or a service or 
application advertisement for a service or application hosted by the first peer and which is 
associated with and accessible via the pipe endpoint. As indicated at 504, the second peer 
may discover or otherwise obtain the pipe advertisement; for example, the second peer 
may find the pipe advertisement in a resource advertisement discovered by the second 
peer. The second peer then may bind an endpoint of the second peer to the pipe 
advertisement as indicated at 506. The endpoint of the second peer node may be 
associated with a service or application hosted by the second peer node. Binding the pipe 
advertisement to the endpoint may include connecting the endpoint to the pipe, and also 
may include discovering one or more endpoints (e.g. input pipes) currently bound to the 
pipe, including the endpoint of the second node. 

After binding to the pipe advertisement, the second peer may communicate with 
the first peer over the pipe as indicated at 508. Communicating over the pipe may include 
sending messages formatted in accordance with one or more peer-to-peer platform 
protocols over the pipe. In one embodiment, if the pipe is a unidirectional pipe, the 
endpoint of the second peer node may be an output pipe for sending messages, and the 
endpoint of the first peer node may be an input pipe. If the pipe is a bi-directional pipe, 
both endpoints may act as input pipes and output pipes. If the pipe is a propagate pipe, 
there may be one or more other endpoints bound to the pipe, and messages sent on the 
pipe from the output pipe may be received by all the endpoints currently bound to the 
pipe. If the endpoint of the first peer node is associated with a service or application 
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hosted by the first peer node, the second peer node may use the pipe to access the service 
or application. If the endpoint of the second peer node is associated with a service or 
application hosted by the second peer node, then the service or application on the first 
peer node may use the pipe to communicate with the service or application on the first 
5 peer node. 

Figure 32 is a flowchart illustrating a method for creating a connection between 
peers in a peer-to-peer networking environment using a pipe service according to one 
embodiment. In one embodiment, a peer group may include two or more peers. As 
indicated at 520, at least one peer in the peer group may host a pipe service. The pipe 
service may cache information about one or more pipes, which may be considered 
resources in the peer group. As indicated at 522, a first peer in the peer group may 
implement and advertise a pipe. In one embodiment, the pipe may be bound to an 
endpoint of the first peer. The endpoint may be associated with a service or application 
hosted by the first peer, and the service or application may be accessible to other peers in 
the peer group over the pipe. The pipe service may get information about the pipe 
implemented by the first peer and cache the information. The information about the pipe 
may identify all endpoints bound to the pipe. 

Q 20 As indicated at 524, a second peer in the peer group may discover the advertised 

1 111 pipe. The second peer may discover the pipe advertisement, or alternatively may receive 

the pipe advertisement in a message received on the network or in an advertisement for a 
resource (e.g. the first peer, the peer group, or the service or application hosted by the first 
peer associated with the endpoint of the first peer). The second peer may then request 
25 information about the pipe as indicated at 526. In one embodiment, the second peer may 
send a query message formatted in accordance with a pipe binding protocol to the pipe 
service to discover information about the advertised pipe including endpoints bound to 
the pipe. The pipe service may then get the requested information as indicated at 528 and 
send the requested information, for example in a response message formatted in 
30 accordance with the pipe binding protocol, to the second peer as indicated at 530. The 
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pipe service may attempt to locate the requested information in the cache. If the 
requested information is in the cache, the pipe service may send the cached information 
about the pipe to the second peer. If the requested information is not in the cache, or if 
the query message indicates that the cached information is not to be used, the pipe service 
5 may attempt to obtain the information on the network using a discovery method as 
described elsewhere in this document. The pipe service may cache the newly discovered 
information about the pipe in the cache, replacing information about the pipe that is 
already cached, if any. 



10 The second peer may bind the pipe advertisement to an endpoint of the second 

peer as indicated at 532. In one embodiment, this binding may be done at any time after 
I ^ the second peer receives the pipe advertisement. After binding to the pipe and receiving 

Jj3 information about one or more other endpoints bound to the pipe, the second peer may 

Iff communicate with the other endpoints bound to the pipe over the pipe, including the 

j?p 15 endpoint of the first peer. 

I n 

w Note that the two methods described in Figures 31 and 32 are merely examples. 

I J The methods may be implemented in software, hardware, or a combination thereof. The 

£!f order of method may be changed, and various elements may be added, reordered, 

Q. 20 combined, omitted, modified, etc. 

m 

Messages 

In one embodiment, the peer-to-peer platform may use asynchronous messages as 
a basis for providing Internet-scalable peer-to-peer communication. The information 

25 transmitted using pipes may be packaged as messages. Messages define an envelope to 
transfer any kinds of data. A message may contain an arbitrary number of named 
subsections which can hold any form of data. In one embodiment, the messages may be 
in a markup language. In one embodiment, the markup language is XML. Each peer's 
messaging layer may deliver an ordered sequence of bytes from the peer to another peer. 

30 The messaging layer may send information as a sequence of bytes in one atomic message 



Atty. Dkt No.: 5681-07400/ P7109 



47 



Conley Rose & Tayon, P.C. 



unit. In one embodiment, messages may be sent between peer endpoints. In one 
embodiment, an endpoint may be defined as a logical destination (e.g. embodied as a 
URN) on any networking transport capable of sending and receiving Datagram-style 
messages. Endpoints are typically mapped into physical addresses by the messaging layer 
at runtime. 

In one embodiment, a message may be a Datagram that may include an envelope 
and a stack of protocol headers with bodies and an optional trailer. The envelope may 
include, but is not limited to, a header, a message digest, (optionally) the source endpoint, 
and the destination endpoint. In one embodiment, each protocol header may include, but 
is not limited to, a tag naming the protocol in use and a body length. Each protocol body 
may be a variable length amount of bytes that is protocol tag dependent. Each protocol 
body may include, but is not limited to, one or more credentials used to identify the 
sender to the receiver. Such a message format preferably supports multiple transport 
standards. An optional trailer may include traces and accounting information. 

The messaging layer may use the transport specified by the URN to send and 
receive messages. In one embodiment, both reliable connection-based transports such as 
TCP/IP and unreliable connectionless transports like UDP/IP may be supported. Other 
existing message transports such as IrDA, and emerging transports like Bluetooth may 
also be supported using the peer endpoint addressing scheme. Peer-to-peer platform 
messages are preferably useable on top of asynchronous, unreliable, and unidirectional 
transport. The peer-to-peer platform protocols preferably use a low-level message 
transport layer (e.g. XML) as a basis for providing Internet-scalable peer-to-peer 
communication. The peer-to-peer platform preferably does not assume that the 
networking transport is IP-based. 

The message digest in the envelope may be used to guarantee the data integrity of 
messages. Messages may also be encrypted and signed for confidentiality and 
refutability. In one embodiment, each protocol body may include one or more credentials 
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used to identify the sender to the receiver. A credential is a key that, when presented in a 
message body, may be used to identify a sender and to verify that sender's right to send 
the message to the specified endpoint. The credential may be an opaque token that is 
preferably presented each time a message is sent. In one embodiment, the sending 
address placed in the message envelope may be crosschecked with the sender's identity in 
the credential. Credentials may be stored in the message body on a per-protocol <tag> 
basis. In one embodiment, the exact format and content of the credentials are not 
specified by the peer-to-peer platform. For example, a credential may be a signature that 
provides proof of message integrity and/or origin. As another example, a message body 
may be encrypted, with the credential providing further information on how to decrypt the 
content. In one embodiment, each credential's implementation may be specified as a 
plug-in configuration, which preferably allows multiple authentication configurations to 
coexist on the same network. 

When an unreliable networking transport is used, each message may be delivered 
more than once to the same destination or may not arrive at the destination. Two or more 
messages may arrive in a different order than sent. In one embodiment, high-level 
communication services layered upon the core protocols may perform message re- 
ordering, duplicate message removal, and processing acknowledgement messages that 
indicate some previously sent message actually arrived at a peer. Regardless of transport, 
messages may be unicast (point to point) between two peers or may be propagated (like a 
multicast) to a peer group. Preferably, no multicast support in the underlying transport is 
required. In one embodiment, peers receiving a corrupted or compromised message may 
discard the message. Messages may be corrupted or intentionally altered in transmission 
on the network. 

The peer-to-peer platform preferably does not mandate how messages are 
propagated. For example, when a peer sends out a peer discovery message, the peer 
discovery protocol preferably does not dictate if the message should be confined to the 
local area network only, or if it must be propagated to every corner of the world. 
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The peer-to-peer platform messages 252 are preferably defined with the envelope 
250 as illustrated in Figure 5. In one embodiment, the messages are defined in a markup 
language. In one embodiment, the markup language is XML. The following is an 
exemplary message in XML: 

<?xml version="1.0" encoding="UTF-8"?> 
<SampleMessage> 

<SampleMessageVersion> version number "1.0"</SampleMessageVersion> 
<SampleMessageDest> destination peer id </SampleMessageDest> 
<SampleMessageSrc> source peer id </SampleMessageSrc> 
<SampleMessageDigest> digest </SampleMessageDigest> 
<SampleMessageTagName> tag </SampleMessageTagName> 
<SampleMessageTagData> body </SampleMessageTagData> 



<SampleMessageTagName> tag </SampleMessageTagName> 
<SampleMessageTagData> body </SampleMessageTagData> 
<SampleMessageTrailer> String</ SampleMessageTrailer > 
</SampleMessage> 

The version number may be a string. The destination and source peer identifier 
may be represented as peer-to-peer platform identifiers. In one embodiment, the digest is 
either an MD5 or SHA1 hash or a digital signature. The digest may serve as a placeholder 
for either. A message may have as many tag parts as needed. In one embodiment, the tag 
name may be a string and the body may be a byte array containing a string without XML 
escape characters ("<" ' V) or a base64 encoded string. 

In one embodiment, the message format may support binary data and/or multi-part 
messages with MIME-types. The message format may allow for arbitrary message header 
fields, including optional header fields. The message format may allow for data 
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verification of message content and the cryptographic signing of messages. The message 
format may provide an arbitrary number of named subsections that may contain any form 
of data of any (reasonable) size. The message format may be "email-safe" such that its 
contents may be extracted reliably after standard textual transformations committed my 
5 E-mail client and server software. 



Reliable Connections 

As previously mentioned, pipes may not necessarily provide reliable delivery of 
messages. A mechanism is described to implement reliable communications channels 
10 between peers over pipes as described in this document. It is to be noted, however, that 
the mechanism described herein may be implemented on other connections between peers 
j, j in peer-to-peer environments than those described herein. 



U1 Figures 33A and 33B illustrate two exemplary peers implementing a reliable 

m 

p 15 communications channel over a pipe according to one embodiment. In one embodiment, 
a communications channel may be established between peers in a peer-to-peer 

51 environment. In one embodiment, the communications channel 416 may be established 

|4 over a pipe 416. In one embodiment, the communications channel 416 may be 

ri 
ft 



established on a unidirectional, asynchronous connection (e.g. pipe, as described 



«* 20 elsewhere herein). In one embodiment, the communications channel 416 may be 
established on a bi-directional, synchronous connection (e.g. pipe, as described elsewhere 
herein). 



A peer 200A may generate messages 412 to send to the other peer 200B. Peer 
25 200A may buffer the generated messages until a transmit window 414 of N messages 
have been buffered, where N is a positive integer (in this example, N = 4). The peer 
200A may then transmit the window 414 of N messages over the communications 
channel 416 to the second peer. The peer 200A may continue to generate messages 412. 
Peer 200B may receive the transmitted messages 412 on the communications channel 
30 416. In one embodiment, the messages 412 may be received in arbitrary order. If the 
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underlying network connection is unreliable, one or more of the messages 412 may not be 
received. After receiving a receive window 418 of M messages 412, peer 200B may send 
an acknowledgement to peer 200 A that the M messages 412 have been received, where M 
is a positive integer. In one embodiment, M is less than or equal to N. In one 
embodiment, M is less than R In one embodiment, N is an even integer, and M = N / 2. 

In one embodiment, each message may include a sequence number configured for 
use in maintaining ordering of received messages on a receiving peer. Peer 200B may 
check the sequence number of each received message 412 and store the first M messages 
412 in the sequence of N transmitted messages 412 in receive window 418. Other 
received messages 412 in the sequence of N transmitted messages may be buffered by 
peer 200B, or alternatively may be discarded (as the discarded messages may be 
retransmitted in the next transmit window 414). In one embodiment, peer 200B may 
monitor elapsed time since the receipt of a first of the N transmitted messages 412. If a 
timeout limit is exceeded before the first M messages 412 in the sequence of N 
transmitted messages 412 is received, peer 200B may send an acknowledgement to peer 
200A indicating the last (e.g. highest sequence number) of a continuous sequence of 
messages 412 (starting at the lowest sequence number) received and buffered in receive 
window 418. Note that, if peer 200B receives more than M messages 412, or alternatively 
one or more messages 412 above the Mth message in the sequence of transmitted 
messages 412, the messages 412 may be buffered and, after acknowledging and/or 
processing the messages 412 in receive window 418, one or more of the buffered 
messages 412 may be moved into the receive buffer 418. Alternatively, the receive buffer 
418 may be shifted on a buffer of received messages and may include one or more, if any, 
previously received messages 412. 

As illustrated in Figure 33B, after receiving the acknowledgement, peer 200 A may 
shift the window 414 by the actual number of messages 412 received by peer 200B as 
indicated in the acknowledgement, and may then transmit any messages 412 in window 
414 to peer 200B. In one embodiment, there may be less than or equal to N messages 412 
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in window 414 when transmitted. Note that, if M is less than N, then one or more 
messages 412 that were previously transmitted to peer 200B may be retransmitted. If 
peer 200B receives retransmitted messages 412 that it has previously received and 
buffered, it may discard the duplicate received messages 412, or alternatively may 
5 overwrite the previously received copies of the messages 412. 



□ 



m. 



In one embodiment, peer 200B may request retransmission of one or more 
messages 412. In one embodiment, the request for retransmission may include one or 
more sequence numbers, or alternatively a range of sequence numbers, of messages 412 
10 requested for retransmission. In one embodiment, the request for retransmission may 
specify one or more previously received messages 412. For example, if one or more 
previously received messages 412 are overwritten or otherwise lost on the receiver peer 
200B before being processed, peer 200B may send a message to peer 200A requesting 



j;H retransmission of the messages 412. In one embodiment, the request for retransmission 

% 15 may specify one or more messages 412 that have not been received. For example, if the 



receiving peer 200B discovers a gap in sequence numbers of received messages 412, peer 
200B may send a request for retransmission of the missing messages 412. In one 
embodiment, the request for retransmission may be a message formatted in accordance 
with a peer-to-peer platform protocol, such as the pipe binding protocol or endpoint 
20 routing protocol. 

Communications channel 416 may make multiple hops on the network 106. In 
one embodiment, different hops in the connection may use different underlying network 
protocols. Communications channel may also pass through one or more firewalls and/or 

25 one or more gateways on the network 106. Communications channel 416 may also pass 
through one or more router (relay) peers on the network 106. In one embodiment, the 
relay peers may simply receive messages and forward the messages. In this embodiment, 
the relay peers may not acknowledge received and/or transmitted messages 412, and/or 
may not maintain sequencing of the messages 412. Thus, the mechanism for reliable 

30 connections as described herein may provide reliable delivery of messages over a network 
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connection regardless of the implementation of that connection (multiple hops, firewalls, 
gateways, relay peers, etc.). 

hi one embodiment, the communications channel may be implemented on a 
propagate pipe as described herein. In this embodiment, other peer nodes may connect to 
the communications channel, receive messages from peer node 200A over the 
communications channel, transmit acknowledgements that one or more of the transmitted 
messages have been received, and the peer node may then retransmit messages not 
acknowledged as received by the other peer nodes on the communications channel. 

In one embodiment, peer 200B may reliably transmit messages to peer 200A over 
the same communication channel 416 using the same or similar method as described for 
Figures 33A-33B to thus provide reliable bi-directional message deliver over the 
communications channel 416. In one embodiment, a different communication channel 
may be established between the two peers for peer 200B to transmit messages to peer 
200A over, and the same or similar method as described for Figures 33A-33B may be 
used on the different communications channel to thus provide reliable bi-directional 
message delivery. 

In one embodiment, establishing, operating, maintaining, and monitoring the 
reliable communications channel, including the transmit and receive windows and the 
transmission, reception, and acknowledgement of received messages may be performed 
by a pipe service. In one embodiment, each peer coupled to the reliable communications 
channel may include an instance of the pipe service. 

Figures 34A-34E illustrate operations of a transmit window and a receive window 
according to one embodiment. In this example, the size N of transmit window 414 is 
eight, and the size M of receive window 418 is four. These sizes are exemplary, and 
virtually any size may be used for receive and transmit windows. Li one embodiment, the 
receive window size is less than the transmit window size. In other embodiments the 
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receive window size may be equal to or larger than the transmit window size. Also in this 
example, each message includes a sequence number for ordering received messages on 
the receiving peer. Figure 34 A illustrates transmitting messages 412A-412H in window 
414 from a source peer to a destination peer. The destination peer may receive the 
messages 412 in arbitrary order. In this example, the destination peer first receives 
messages 212A and 212C as indicated in Figure 34A. In Figure 34B, the destination peer 
receives messages 212B and 21 2D, and thus receive window 418 is full. The destination 
peer may then send an acknowledgement 420A to the source peer indicating the number 
of messages received in the receive window 418 (in this case, four). Note that the 
destination peer may also receive one or more of the other transmitted messages 
(messages 412E-412H), but does not at this time store them in the receive window. In 
one embodiment the destination peer may discard these messages, or alternatively may 
buffer these messages for later processing. 

In Figure 34C, after receiving acknowledgement 420A, the source peer may shift 
the transmit window 414 by the number of messages received in the receive window as 
indicated by the acknowledgement 420 A. In this case, the transmit window 414 is shifted 
by four. The source peer may then transmit the messages 412 in the shifted transmit 
window 414 (messages 412E-412L), the destination peer may receive and send 
acknowledgement 420B indicating the receipt of the first four messages 212 (messages 
412E-412H) in the sequence of transmitted messages from the transmit window 414. 

In Figure 34D, after receiving acknowledgement 420B, the source peer may shift 
the transmit window 414 by the number of messages received in the receive window as 
indicated by the acknowledgement 420B. In this case, the transmit window 414 is shifted 
by four. Note that this example indicates that there are only five messages remaining to 
transmit. The source peer may then transmit the messages 412 in the shifted transmit 
window 414 (messages 412I-412M). The destination peer may receive a portion of the 
transmitted messages 412, in this example, messages 412I-412K. In one embodiment, the 
receiving peer may wait for the remaining messages 412 until the receive window 418 is 
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full (e.g., in this example, until message 412L is received) or until a timeout period has 
expired, where timing is started at the receipt of the first message 412 from the current 
window 414 of transmitted messages 412 (note that, in embodiments where the messages 
412 may be received in arbitrary order, the first received message may be any message in 
the sequence of messages transmitted from the transmit window 414.) If the timeout 
period expires, then the destination peer may send an acknowledgement 420C to the 
source peer indicating the last message 412 in a continuous sequence of messages 412 in 
the receive window 418 starting from the first message 412 in the sequence of transmitted 
messages. Note that, if the first message in the sequence of transmitted messages is not 
received, the acknowledgement will indicate that no messages have been placed in 
receive window 418, even if one or more others of the transmitted messages 412 were 
received. In this example, the acknowledgement 420C indicates that message 412K was 
the last message received and placed in the receive window 418. 

In Figure 34E, after receiving acknowledgement 420C, the source peer may shift 
the transmit window 414 by the number of messages received in the receive window as 
indicated by the acknowledgement 420C. In this case, the transmit window 414 is shifted 
by three. The source peer may then transmit the messages 412 in the shifted transmit 
window 414 (messages 412L-412M). The destination peer may then receive the 
transmitted messages 412 and place them in the receive window 418. In one 
embodiment, the destination peer may wait until the timeout period expires, and then 
transmit acknowledgement message 416 indicating that the two messages have been 
received. In another embodiment, message 412M may include an indication that it is the 
last message in the transmit window 414 so that the destination peer does not have to wait 
for a timeout when in reality there are no more messages to be received, but instead may 
send the acknowledgement message 416 indicating that the two messages have been 
received after receiving the last message 412M and all lower-sequence messages 412 that 
were sent in the last transmission from the source window 414. 

In one embodiment, peers 200A and 200B may monitor and evaluate the 
reliability of message delivery over the communications channel and may dynamically 



Atty. Dkt No.: 5681-07400/ P7109 



56 



Conley Rose & Tayon, P.C. 



adjust the sizes of the transmit window (N) and the receive window (M) based upon 
evaluation of the reliability. For example, if the retransmission rate of messages is high 
(e.g. over a predetermined threshold rate), then the values of M and/or N may be lowered. 
If the retransmission rate of messages is low (e.g. if few or no messages are not received 

5 and thus require retransmission, and/or if the timeout period for receiving messages in the 
receive window is seldom if ever exceeded), then the values of M and/or N may be raised 
to transmit and receive more messages during each iteration. One skilled in the art will 
recognize that there are a variety of methods to implement collecting and evaluating 
feedback parameters to determine the quality of a connection and, if necessary, adjust 

10 data flow rates accordingly. 



y s Figures 35A-35D are flowcharts illustrating a method for providing a reliable 

connection between peers in a peer-to-peer networking environment according to one 
IM embodiment. In Figure 35A, two peers may first establish a communications channel as 

! I a 

i;p 15 indicated at 600. As indicated at 602, one of the peers may be a source peer, and may 
transmit messages to the other (destination) peer over the communications channel. The 
source peer may then receive acknowledgement that one or more of the transmitted 
messages have been received by the destination peer as indicated at 604, and then 
retransmit messages not acknowledged as received by the other peer on the 
20 communications channel as indicated at 606. In one embodiment, the destination peer 
may request retransmission of messages. In one embodiment, the request for 
retransmission may include one or more sequence numbers, or alternatively a range of 
sequence numbers, of messages requested for retransmission. 



Q 



FU 



25 Figure 35B is a flowchart expanding on 602 of Figure 35A. As indicated at 602A, 

the source peer may generate and buffer the messages and, after a window of N messages 
has been buffered, transmit the N messages to the destination peer node over the 
communications channel as indicated at 602B. 
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Figure 35C is a flowchart expanding on 604 of Figure 35A. As indicated 604A ? 
the destination peer may receive the transmitted messages, and, after receiving a window 
of M messages, transmit the acknowledgement to the peer node indicating that the M 
messages have been received as indicated at 604B. 

Figure 35D is a flowchart expanding on 606 of Figure 35A. As indicated at 606A, 
the source peer node may, after receiving the acknowledgement indicating that the M 
messages have been received, shift the transmit window in the buffer by M messages and 
transmit the messages in the shifted window to the destination peer node over the 
communications channel as indicated at 606B. 

Note that the methods described in Figures 35A-35D are merely examples. The 
methods may be implemented in software, hardware, or a combination thereof. The order 
of method may be changed, and various elements may be added, reordered, combined, 
omitted, modified, etc. 

Services 

Peers may cooperate and communicate to publish, discover and invoke network 
services. A service denotes a set of functions that a provider offers. In one embodiment, a 
peer-to-peer platform peer can offer a service by itself or in cooperation with other peers. 
In one embodiment, a peer may publicize a service by publishing a service advertisement 
for the service. Other peers may then discover this service using the peer discovery 
protocol (through the advertisement) and make use of it. A peer may publish as many 
services as it can provide. 

In one embodiment, services may either be pre-installed into a peer or loaded from 
the network. The process of finding, downloading and installing a service from the 
network may include performing a search on the network for the service, retrieving the 
service, and then installing the service. Once a service is installed and activated, pipes 
may be used to communicate with the service. In one embodiment, peer-to-peer 
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platform-enabled services may publish pipe advertisements as their main invocation 
mechanism. The service advertisement may specify one or more pipe advertisements that 
may be used by a peer to create output pipes to invoke the service. The service 
advertisement may also include a list of predetermined messages that may be sent by a 
peer to interact with the service. The service advertisement may describe all messages 
that a client may send or receive. 

Several methods may be provided by various embodiments to publish a service. 
Services may be published before creating a new peer group by adding the service 
advertisement to the peer group advertisement. Services may also be published by adding 
the services in a separate peer service advertisement. The discovery service may also 
allow new advertisements to be added at runtime. The new advertisement will belong to a 
predefined peer group. Other methods of publishing services may be provided. Note that 
service advertisements may be placed in the peer group advertisement of any group. 
Since all peers belong to the global peer group, a peer may publish the service in the 
global peer group advertisement to make it available to any peer. 

In one embodiment, services advertised in a peer group advertisement are 
instantiated for a peer when the peer joins the group. In one embodiment, all the services 
are instantiated. In another embodiment, none, one or more of the advertised services may 
be instantiated when the peer joins the peer group. Service advertisements in the peer 
group advertisement may include resolver, discovery, membership, peer information and 
pipe service advertisements. In one embodiment, services advertised in a peer group 
advertisement are loaded on the peer when the peer boots. In one embodiment, this 
automated loading is not mandatory but is part of the Java Binding. One embodiment may 
provide a mechanism to force a service in a peer group advertisement to be instantiated 
by a peer. 

In one embodiment, when a peer boots, any services advertised in the peer 
advertisement are loaded. The peer advertisement corresponds to the platform 
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advertisement. These services may include the minimal set of services to bootstrap the 
creation of new peers: discovery service, membership service, resolver service, peer 
information service and pipe service. 

In one embodiment, when a peer switches from one peer group to another, the 
first group's services remain active. In one embodiment, a peer may call a stop method on 
the service application interface to stop an instance of a local service. A peer that is a 
member of one peer group that refers to a service may join a second peer group that also 
refers to the service while still a member of the first. Whether the service is instantiated 
once or twice may depend on the service implementation. Some service implementations 
may use a static instantiation that is done once. In this case, all groups share the same 
instance. Other service implementations are local to a peer group and are not aware of the 
state of any other peer groups on the same node. 

In one embodiment, services may use a "time to live" indicator that defines when 
the service was created, and would also define the lifetime of the service. After its 
lifetime has expired, the stale service may be purged. 

A service may be well defined and widely available so that a peer can use it 
directly. Other services may require special code in order to actually access the service. 
For example, the way to interface with the service provider may be encoded in a piece of 
software. In this case, it is preferable if a peer can locate an implementation that is 
suitable for the peer's specific runtime environment. In one embodiment, if multiple 
implementations of the same service are available, then peers hosted on Java runtimes can 
use Java programming language implementations while native peers to use native code 
implementations. In one embodiment, service implementations may be pre-installed into 
a peer node or loaded from the network. In one embodiment, once a service is installed 
and activated, pipes may be used to communicate with the service. 
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In one embodiment, each service may have a unique identifier. In one 
embodiment, a service may have a name that may include a canonical name string that 
may indicate the type and/or purpose of the service. A service may also provide optional 
information (e.g. a set of descriptive keywords) that further describes the service. The 
5 unique identifier, name and optional information may be stored within a service 
advertisement. The advertisement may also include other information needed to configure 
and instantiate a service. 



In one embodiment, the peer-to-peer platform may recognize two levels of 
10 services, peer services and peer group services. A service that executes only on a single 
peer may be referred to as a peer service. A peer service is accessible only on the peer that 
i 4 is publishing the service. If that peer happens to fail, then service also fails. This level of 

j;2 service reliability may be acceptable for an embedded device, for example, providing a 

lit 



calendar and email client to a single user. Multiple instances of the service may be run on 
15 different peers, but each instance publishes its own advertisement. A service that is 
composed of a collection of cooperating instances (potentially cooperating with each 
« other) of the service running on multiple peers in a peer group may be referred to as a 

|4 peer group service. A peer group service may employ fault tolerance algorithms to 

j,§f provide the service at a higher level of availability than that a peer service can offer. If 

y 20 any one peer fails, the collective peer group service may not be affected, because the 

fit 

service may still be available from at least one other peer member. Peer group services 
may be published as part of the peer group advertisement. 



Li one embodiment, the peer-to-peer platform may include a set of default peer 
25 group services such as peer discovery, as well as a set of configurable services such as 
routing. In one embodiment, a peer-to-peer platform peer may not be required to have one 
or all of these services. For example, a cell phone peer may be pre-configured with 
enough information to contact a fixed server provided by the telecom operator. This may 
be enough to bootstrap the cell phone peer without requiring it to independently carry 
30 with it additional services. 
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In one embodiment, although the concept of a service is orthogonal to that of a 
peer and a peer group, a peer group formed using the peer-to-peer platform may require a 
minimum set of services needed to support the operation of the group. Some services 
may be well known and may be referred to as peer-to-peer platform core services. 
Embodiments of the peer-to-peer platform may define a set of core peer group services 
that may be used to form and support peer groups. In one embodiment, the core peer 
group services may provide the minimum services required to form a peer group (e.g. 
membership and discovery services). The peer-to-peer platform core services are 
preferably 100% decentralized and thus may enable pure peer-to-peer network 
computing. In one embodiment, it is not required that all core services be implemented 
by every peer group. 

In one embodiment, the peer-to-peer platform may define peer group core services 
including, but not limited to, a discovery service, a membership service, an access 
service, a pipe service, a resolver service and a monitoring service. A discovery service 
may be used to search for peer group resources such as peers, peer groups, and pipes. The 
search criteria may include a resource name. Discovery and discovery services are 
described more fully later in this document. 

In one embodiment, most peer groups will have at least a membership service. 
Current peer group members may use the membership service during the login process to 
reject or accept a new peer group membership application. The membership service may 
be a "null" authenticator service that imposes no real membership policy. Peers wishing 
to join a peer group first locate a current member, and then request to join. The 
application to join may be either rejected or accepted by the collective set of current 
members. The membership service may enforce a vote of peers or alternatively elect a 
designated group representative to accept or reject new membership applications. 
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An access service may be used to validate, distribute, and authenticate a group 
member's credentials. The access service may define the type of credential used in the 
message-based protocols used within the peer group. The access service may be used to 
validate requests made by one peer to another. The peer receiving the request provides the 
requesting peer's credentials and information about the request being made to the access 
service to determine if the access is permitted. In one embodiment, not all actions within 
the peer group need to be checked with the access service, only those actions which only 
some peers are permitted to use. 

A pipe service may be used to establish and manage pipe connections between the 
different peer group members. A resolver service may be used to send query string to 
peers to find information about a peer, a peer group, a service or a pipe. A monitoring 
service is used to allow one peer to monitor other members of the same peer group. 

In on embodiment, not all the above services are required to be implemented by a 
peer group. Each service may implement one or more of the peer-to-peer platform 
protocols. A service preferably implements one protocol for simplicity and modularity 
reasons, but some services may not implement any protocols. 

Other services may be user-defined and provide application dependent services 
such as content searching and indexing. A user-defined service may provide additional 
APIs. User-defined services may be implemented that may offer the ability to mix-in 
centralization as a means of increasing performance. In one embodiment, the peer-to- 
peer platform core services may provide a reference implementation for user-defined 
services. Examples of user defined services may include, but are not limited to: 

• Efficient long-distance peer lookup and rendezvous using a peer naming and 
discovery service. 

• Simple, low-cost information search and indexing using a content sharing service. 
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• Interoperability with existing centralized networking infrastructure and security 
authorities in corporate, public, private, or university networks using 
administration services. 

• A resolver service may be implemented to find active (running on some peer) and 
inactive (not yet running) service instances. 

• An FTP service that allows file transfers among peers over pipes using FTP. 

Advertisements 

In one embodiment, the peer-to-peer protocols may use advertisements to describe 
and publish the existence of peer resources. An advertisement may be defined as a 
structured, language neutral metadata structure that names, describes, and publishes the 
existence of a peer-to-peer platform resource, such as a peer, a peer group, a pipe, or a 
service. 

In one embodiment, advertisements may be used in the peer-to-peer platform as 
language-neutral metadata structures. In one embodiment, each software platform binding 
may describe how advertisements are converted to and from native data structures such as 
Java objects or 6 C structures. Each protocol specification may describe one or more 
request and response message pairs. In one embodiment, advertisements may be the most 
common document exchanged in messages. 

Information exchanged between peers may include advertisement documents. The 
peer-to-peer platform preferably includes advertisement documents to represent all of the 
peer-to-peer platform resources managed by the core platform, such as peers, peer groups, 
pipes and services. In one embodiment, the peer-to-peer platform may define a set of 
core advertisements. The peer-to-peer platform may define core advertisement types 
including, but not limited to, one or more of peer advertisements, peer group 
advertisements, pipe advertisements, service advertisements, content advertisements, and 
endpoint advertisements. In one embodiment, user-defined advertisement subtypes (for 
example, using XML schemas) may be formed from these basic types. Subtypes of the 
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core advertisements may be used to add an unlimited amount of extra, richer metadata to 
a peer-to-peer network. The peer-to-peer platform protocols, configurations and core 
software services however, preferably operate only on the core advertisements. 

In one embodiment, an advertisement is a markup language structured document 
that names, describes, and publishes the existence of a peer-to-peer platform resource. In 
one embodiment, peer-to-peer platform advertisements may be represented in the 
Extensible Markup Language (XML) and are therefore software platform neutral. XML 
provides a powerful means of representing data and metadata throughout a distributed 
system. XML provides universal (software-platform neutral) data because XML is 
language agnostic, self-describing, strongly-typed and ensures correct syntax. XML 
advertisements may be strongly typed and validated using XML schemas. XML also 
allows advertisements to be translated into other encodings such as HTML and WML. 
This feature allows peers that do not support XML to access advertised resources. In one 
embodiment, each document may be converted to and from a platform specific 
representation such as a Java object. In one embodiment, peers supporting the various 
protocols requiring that advertisements be exchanged in messages may accept only valid 
XML documents that descend from the base XML advertisement types. 

Advertisements represented in a markup language such as XML, like any markup 
language document, may be composed of a series of hierarchically arranged elements. 
Each element may include its data and/or additional elements. An element may also have 
attributes. Attributes are name-value string pairs. An attribute may be used to store 
metadata, which may be used to describe the data within the element. 

In one embodiment, a peer advertisement may be used to describe a peer. A peer 
advertisement may describe the peer resources. One use of a peer advertisement is to 
hold specific information about the peer, such as its name, peer identifier, registered 
services and available endpoints. Figure 6 illustrates the content of a peer advertisement 
according to one embodiment. The following is an example of one embodiment of a peer 
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advertisement in XML, and is not intended to be limiting: 

<?xml version="1.0 M encoding="UTF-8"?> 
<PeerAdvertisement> 

<Name> name of the peer</Name> 

<Keywords>search keywords </Keywords> 

<Pid> Peer identifier </Pid> 

<Services> 

< Service advertisement 

</Service advertisement 
</Services> 
<Endpoints> 

<endpoint advertisement > 

</endpoint advertisement > 
</Endpoint> 
<InitialApp> 

< Service advertisement > 

<l Service advertisement > 
</InitialApp> 
</PeerAdvertisement> 

Embodiments of a peer advertisement may include, but are not limited to, the 
following fields: 

• Name: an optional string that can be associated with a peer. In one embodiment, 
the name is not required to be unique unless the name is obtained from a 
centralized naming service that guarantees name uniqueness. 
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• Keywords: an optional string that may be used to index and search for a peer. In 
one embodiment, the string is not guarantee to be unique. Two peers may have the 
same keywords. The keywords string may contain spaces. 

• Peer identifier: uniquely identifies the peer. In one embodiment, this may be a 
required element. Each peer has a unique identifier. 

• Service: a service advertisement element for each service published on the peer. 
Services started on a peer may publish themselves to the peer. In one embodiment, 
not all services running on the peer need to publish themselves. 

• Endpoint: an endpoint URI (e.g. tcp://129.144.36.190:9701 or 
http://129.144.36. 190:9702) for each endpoint available on the peer. 

• InitialApp: Optional application/service started when the peer is booted. A service 
advertisement is used to describe the service. 

In one embodiment, a peer group advertisement may be used to describe, for a 
peer group, the group specific information (name, peer group identifier, etc.), the 
membership process, and the available peer group services. The peer group 
advertisement defines the core set of services to be used by that peer group. In one 
embodiment, it may not enforce that each peer must run each service locally. Rather it 
defines the set of services that are made available to the peer group. 

In one embodiment, the initial creator of the peer group may define what 
advertisements go into the peer group advertisement at creation time. Other peers may get 
a copy of the peer group advertisement when they discover advertisements via the 
discovery service. In one embodiment, peer group advertisements are immutable objects 
and new services may not be added due to java binding. Other embodiments may allow 
new services to be added. In one embodiment, a peer group may provide a registration 
service that allows the dynamic registration of services. 

Figure 7 illustrates the content of a peer group advertisement according to one 
embodiment. The following is an example of one embodiment of a peer group 
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advertisement in XML, and is not intended to be limiting: 



<?xml version="1.0" encoding="UTF-8"?> 

<PeerGroupAdvertisement> 

<Name> name of the peer group</Name> 
<Keywords>search keywords </Keywords> 
<Gid> Peer group identifier </Gid 
<Services> 

<Service advertisement 

</Service advertisement 
</Services> 
<InitialApp> 

<Service advertisement 

</Service advertisement 
</InitialApp> 
</PeerGroupAdvertisement> 



Embodiments of a peer group advertisement may include, but are not limited to, 
the following fields: 

• Name: an optional name that may be associated with a peer group. In one 
embodiment, the name is not required to be unique unless the name is obtained 
from a centralized naming service that guarantee name uniqueness. 

• Keywords: an optional string that may be used to index and search for a peer 
group. In one embodiment, the string is not guarantee to be unique. Two peer 
groups may have the same keywords. 

• Peer group identifier: uniquely identifies the peer group. In one embodiment, this 
is a required element. Each peer group has a unique id. 
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• Service: a service advertisement element for each peer group service available in 
the peer group. In one embodiment, not all peer group services need to be 
instantiated when a peer joins a peer group. In one embodiment, at least a 
membership service should be available, so the membership service may 
implement a null authenticator membership. 

• InitialApp: optional application/service started when a peer is joining a peer 
group. A service advertisement may be used to describe the service. The initial 
application may be started when a peer is joining a group. Alternatively, it may be 
left to the joining peer to decide to either start or not start the peer group initial 
application. 

Once a peer joins a group, that peer may receive (depending again upon 
membership configuration) a full membership-level peer group advertisement. The full 
membership advertisement, for example, might include the configuration (required of all 
members) to vote for new member approval. 

In one embodiment, a pipe advertisement may be used to describe an instance of a 
pipe communication channel. A pipe advertisement may be used by a pipe service to 
create associated input and output pipe endpoints. In one embodiment, a pipe 
advertisement document may be published and obtained either by using a discovery 
service (e.g. the core discovery service) or by embedding it within other advertisements 
such as the peer or peer group advertisement. Each pipe advertisement may include an 
optional symbolic name that names the pipe and a pipe type to indicate the type of the 
pipe (point-to-point, propagate, secure, etc). Figure 8 illustrates the content of a pipe 
advertisement according to one embodiment. The following is an example of one 
embodiment of a pipe advertisement in XML, and is not intended to be limiting: 

<?xml version="LO n encoding="UTF-8"?> 
<PipeAdvertisement> 

<Name> name of the pipe</Name> 
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< ID > Pipe identifier <l ID > 
<Type> Pipe Type </Type> 
</PipeAdvertisement> 

Embodiments of a pipe advertisement may include, but are not limited to, the 
following fields: 

• Name: an optional name that may be associated with a pipe. In one embodiment, 
the name is not required to be unique unless the name is obtained from a 
centralized naming service that guarantee name uniqueness. 

• Pipe identifier: uniquely identifies the pipe. In one embodiment, this is a required 
element. Each pipe has a unique id. 

• Type: This is an optional pipe type that may be provided to specify the quality of 
services implemented by the pipe. Pipe types may include, but are not limited to: 

- RELIABLE (guaranteed delivery and ordering, and deliver only once) 

- UNRELIABLE (may not arrive at the destination, may be delivered more 
than once to the same destination, may arrive in different order) 

- SECURE (reliable and encrypted transfer) 

In one embodiment, a service advertisement may be used to describe a peer-to-peer 
platform-enabled service. Service advertisements preferably describe how to activate 
and/or use the service. In one embodiment, a peer-to-peer platform-enabled service is a 
service that uses pipes as primary invocation mechanism. To invoke the service, a peer 
may a message to the associated service pipe. In one embodiment, the core peer group 
services that each peer group preferably implements in order to respond to the messages 
described for the peer-to-peer platform protocols are peer-to-peer platform-enabled 
services and thus may be published using service advertisements. The service 
advertisement document may be published and obtained using the peer information 
protocol for peer services, or alternatively using the peer group discovery protocol for peer 
group services. 
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In one embodiment, a pipe advertisement and access method fields may provide a 
placeholder for any kind of service invocation schema that defines the valid set of XML 
messages accepted by the service and the associated message flow. Thus, the peer-to-peer 
platform protocols may be agnostic of service invocation and interoperate with any 
existing framework. A service advertisement access method field may refer to a WSDL 
(e.g. www.w3.org/TR/wsdl), ebXML (e.g. www.ebxml.org), UPnP (e.g. www.upnp.org) 
or a client-proxy schema, among others. For example, a WSDL access method may define 
messages that are abstract descriptions of the data being exchanged and the collections of 
operations supported by the service using a WSDL schema. In one embodiment, a service 
advertisement may include multiple access method tags, as there may be multiple ways to 
invoke a service. Thus, the peer may ultimately decide which invocation mechanism to 
use. For example, small devices may want to use a small-footprint mechanism or a service 
framework they already have the code for, and larger devices may decide to download a 
client-proxy code. 

In one embodiment, the access method for services is a schema of valid XML 
messages accepted by the service. In one embodiment, a service advertisement may 
contain a URL or URI tag to point to a jar file, DLL, or loadable library. A peer may use 
this to download the code to run the service, for example if the peer joins the peer group 
and doesn't have the required code to run the service. 

In one embodiment, once a service advertisement is sent out into the world there 
is no method of pulling it back in. However, each individual peer may have the ability to 
purge the set of cached advertisements that reside locally, and a rendezvous peer may 
purge its cache periodically (e.g. daily). 

Figure 9 illustrates the content of a service advertisement according to one 
embodiment. The following is an example of one embodiment of a service advertisement 
in XML, and is not intended to be limiting: 
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<?xml version="LO" encoding= n UTF-8"?> 
<ServiceAdvertisement> 

<Name> name of the Service</Name> 

<Version> Version identifier </Version> 

<Keywords>search keywords </Keywords> 

<ID> Service identifier <UD> 

<Pipe> Pipe endpoint to access the service </Pipe> 

<Params> service configuration parameters </Params> 

<URI> service provider location</URI> 

<Provider> Service Provider</Provider> 

<AccessMethods> 

</AcessMethods> 
</ServiceAdvertisement> 

Embodiments of a service advertisement may include, but are not limited to, the 
following fields: 

• Name: an optional name that may be associated with a service. In one 
embodiment, the name is not required to be unique unless the name is obtained 
from a centralized naming service that guarantees name uniqueness. 

• Keywords: an optional string that may be used to index and search for a service. 
In one embodiment, the string is not guaranteed to be unique. Two services may 
have the same keywords. 

• Service identifier: uniquely identifies a service. In one embodiment, each service 
has a unique id. In one embodiment, this element may be required. 

• Version: specifies the service version number. In one embodiment, this element 
may be required. 

• Provider: gives information about the provider of the service. This will typically 
be a vendor name. In one embodiment, this element may be required. 
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• Pipe: an optional element that specifies a pipe advertisement to be used to create 
an output pipe to connect to the service. In one embodiment, services are not 
required to use pipes. 

• Params: a list of configuration parameters available to the peer when invoking the 
service. In one embodiment, the parameter field is optional. Parameters may be 
defined as a list of strings. 

• URI: This is an optional parameter that may be used to specify the location of 
where the code for the service may be found. 

• Access Methods: In one embodiment, at least one access method is required to 
specify how to invoke the service. Multiple access method tags may be used when 
multiple access methods are available. The access method tag allows any kind of 
service invocation representation to be specified. For example the access method 
may be a placeholder for a WSDL or uPnP document that describes a web service 
access method. 

In one embodiment, a content advertisement may be used to describe a content 
document stored somewhere in a peer group. In one embodiment, there are no 
restrictions on the type of contents that can be represented. A content may be a file, a 
byte array, code or process state, for example. In one embodiment, each item of content 
may have a unique identifier also known as its canonical name. The unique identifier may 
include a peer group universal unique identifier (UUID), and also may include another 
name that may be computed, parsed, and maintained by peer group members. In one 
embodiment, the content's name implementation within the peer group is not mandated 
by the peer-to-peer platform. The name may be a hash code, a URI, or a name generated 
by any suitable means of uniquely identifying content within a peer group. The entire 
canonical content name may be referred to as a content identifier or content ID. Figure 3 
illustrates an exemplary content identifier according to one embodiment. 

Figure 10 illustrates a content advertisement according to one embodiment. A 
size element is preferably provided for all content items and gives the total size of the 
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content. In one embodiment, the size is in bytes. In one embodiment, the size is a long 
(unsigned 64-bits). A content advertisement may also include a MME (Multi-Purpose 
Internet Mail Extensions) type that describes the MIME type (encoding may be deduced 
from the type) of the in-line or referenced data. A content advertisement may also 
include a ReflDD element. If the advertised content is another advertisement (based upon 
its type), the RefID is the content identifier of the referenced content. If the advertised 
content is not another advertisement, the RefID element may be omitted. 

The following is an example of one embodiment of a content advertisement in 
XML, and is not intended to be limiting: 

<?xml version="L0" encoding= M UTF-8"?> 
<ContentAdvertisement> 

<Mimetype> name of the pipe</Mimetype> 

<Size> Pipe identifier </Size> 

<Encoding> Pipe Type </Encoding> 

<BD> Content identifier</E)> 

<RefID> Content identifier </RefBD> 

<Document> document </Document> 
</ContentAdvertisement> 

Embodiments of a content advertisement may include, but are not limited to, the 
following fields: 

• ED: in one embodiment, all contents have a unique identifier. 

• Size: the total size of the content. In one embodiment, a long (unsigned 64-bits) 
represented as a string. indicates that the size is unknown. 

• Mimetype: the mime type of the content. The type may be unknown. 

• Encoding: specifies the encoding used. 

• RefID: if the advertised content is about another content, the RefID specifies the 
content identifier of the referenced content. 
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In one embodiment, an endpoint advertisement may be used to describe peer 
transport protocols. In one embodiment, a peer may support one or more transport 
protocols. In one embodiment, peers may have multiple network interfaces. Typically, 
there will be one peer endpoint for each configured network interface and/or protocol 
(e.g. TCP/IP, HTTP). An endpoint advertisement may be included as a tag field in a peer 
advertisement to describe the endpoints available on the peer. In one embodiment, an 
endpoint advertisement document may be published and obtained either by using the core 
discovery service or by embedding it within other advertisements such as the peer 
advertisement. Each endpoint advertisement may include transport binding information 
about each network interface or transport protocol. Endpoints may be represented with a 
virtual endpoint address that may include all necessary information to create a physical 
communication channel on the specific endpoint transport. For example, 
"tcp://123. 124.20.20: 1002" or "http://134.125.23. 10:6002" are strings representing 
endpoint addresses. Figure 11 illustrates the content of an endpoint advertisement 
according to one embodiment. The following is an example of one embodiment of an 
endpoint advertisement in XML, and is not intended to be limiting: 

<?xml version="1.0" encoding= M UTF-8"?> 
<EndpointAdvertisement> 

<Name> name of the endpoint</Name> 

<Keywords> search string </Keywords> 

<Address> endpoint logical address </Address> 
</EndpointAdvertisement> 

Embodiments of an endpoint advertisement may include, but are not limited to, 
the following fields: 

• Name: an optional name that may be associated with an endpoint. In one 
embodiment, the name is not required to be unique unless the name is obtained 
from a centralized naming service that guarantee name uniqueness. 
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• Keywords: an optional string that may be used to index and search for an 
endpoint. In one embodiment, the string is not guarantee to be unique. Two 
endpoints may have the same keywords. 

Peer-to-peer Platform Protocols 

The peer-to-peer platform protocols may be used to provide and support ad hoc, 
pervasive, and multi-hop peer-to-peer (P2P) network computing. Using the protocols, 
peers can cooperate to form self-organized and self-configured peer groups independently 
of their positions in the network (e.g. edges, firewalls), and without the need of a 
centralized management infrastructure. The peer-to-peer platform protocols may have 
very low overhead, make few assumptions about the underlying network transport and 
limited requirements of the peer environment, and may be used to deploy a wide variety 
of P2P applications and services in a highly unreliable and changing network 
environment. 

In one embodiment, the peer-to-peer platform may include core protocols 
including, but not limited to, a peer membership protocol, a peer discovery protocol, a 
peer resolver protocol, a peer information protocol, a pipe binding protocol, and a peer 
endpoint protocol. These protocols may be implemented using a common messaging 
layer. This messaging layer binds the protocols to various network transports. In one 
embodiment, the peer-to-peer platform protocols may be specified as a set of markup 
language (e.g. XML) messages exchanged between peers. Each software platform 
binding describes how a message is converted to and from a native data structures such as 
a Java object or 'C structure. In one embodiment, the use of markup language messages 
to define protocols allows many different kinds of peers to participate in a protocol. Each 
peer is free to implement the protocol in a manner best suited to its abilities and role. 
Peer-to-peer platform messages are described previously in this document. 
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In one embodiment, each of the protocols is independent of the others. Preferably, 
a peer is not required to implement all of the networking protocols. A peer preferably 
needs to implement only the protocol that it requires. For example, a device may have all 
the advertisements it uses pre-stored in memory, so that peer does not need to implement 
the Peer Discovery Protocol. As another example, a peer may use a pre-configured set of 
peer routers to route all its messages, hence the peer does not need to implement the Peer 
Endpoint protocol. Instead, the peer sends messages to the routers to be forwarded. As yet 
another example, a peer may not need to obtain or wish to provide status information to 
other peers, hence the peer does not to implement the peer information protocol. The 
same can be said about all of the other protocols. In one embodiment, a peer may 
implement only a portion (client-side or server-side only, for example) of a protocol. 

Peers may use the peer-to-peer platform protocols to advertise their resources and 
to discover network resources (services, pipes, etc.) available from other peers. Peers may 
form and join peer groups to create special relationships. The peer-to-peer platform 
protocols may allow peers to communicate without needing to understand or manage the 
potentially complex and dynamic network topologies that are becoming common. Peers 
may cooperate to route messages allowing for full peer connectivity. The peer-to-peer 
platform protocols allow peers to dynamically route messages across multiple network 
hops to any destination in the network (potentially traversing firewalls). In a packet- 
switching network, a hop may be defined as the trip a data packet takes from one router or 
intermediate point to another in the network. Each message may include either a complete 
or a partial ordered list of gateway peers through which the message might be routed. If 
route information is incorrect, an intermediate peer may assist in dynamically finding a 
new route. A peer-to-peer platform protocol message that is routed through multiple hops 
is preferably not assumed to be reliably delivered, even if only reliable transports such as 
TCP/IP are used through all hops. A congested peer may drop messages at any time rather 
than routing them. 
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The peer-to-peer platform protocols may be implemented on a variety of networks 
including, but not limited to, the Internet, corporate intranets, dynamic proximity 
networks, home networking environments, LANs and WANs. The peer-to-peer platform 
protocols may allow the peer-to-peer platform to be easily implemented on unidirectional 
links and asymmetric transports. Li particular, many forms of wireless networking do not 
provide equal capability for devices to send and receive. The peer-to-peer platform 
permits any unidirectional link to be used when necessary, improving overall 
performance and network connectivity in the system. Thus, the peer-to-peer platform 
protocols may be easy to implement on any transport. Implementations on reliable and 
bidirectional transports such as TCP/IP or HTTP may provide efficient bidirectional 
communications. Even on bidirectional transports, communication ability between any 
pair of peers may at times not work equally well in both directions. That is, 
communications between two peers will in many cases be able to operate bidirectionally, 
but at times the connection between two peers may be only unidirectional, allowing one 
peer to successfully send messages to the other while no communication is possible in the 
reverse direction. The peer-to-peer platform unidirectional and asymmetric transport also 
plays well in multi-hop network environments where the message latency may be difficult 
to predict. Furthermore, peers in a P2P network tend to have nondeterministic behaviors 
and thus may appear or leave the network very frequently. 

In one embodiment, the peer-to-peer platform protocols do not require a broadcast 
or multicast capability of the underlying network transport. Messages intended for receipt 
by multiple peers (propagation) may be implemented using point-to-point 
communications. The peer-to-peer platform protocols preferably do not require periodic 
messages of any kind at any level to be sent within the network, and thus preferably do 
not require periodic polling, link status sensing, or neighbor detection messages, and may 
not rely on these functions from any underlying network transport in the network. This 
entirely on-demand behavior of the protocols and lack of periodic activity may allow the 
number of overhead messages generated by the peer-to-peer platform to scale all the way 
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down to near or at zero, when all peers are stationary with respect to each other and all 
routes needed for current communication have already been discovered. 

In one embodiment, the peer-to-peer platform protocols are defined as idempotent 
protocol exchanges. The same messages may be sent/received more than once during the 
course of a protocol exchange. Preferably, no protocol states are required to be 
maintained at both ends. Due to the unpredictability of P2P networks, assumptions may 
not be made about the time required for a message to reach a destination peer, and thus 
the peer-to-peer platform protocols preferably do not impose any timing requirements for 
message receipt. 

The peer-to-peer platform protocols may take advantage of additional 
optimizations, such as the easy ability to reverse a source route to obtain a route back to 
the origin of the original route. 

Figure 12 illustrates protocols and bindings in a peer-to-peer platform according 
to one embodiment. When the peer-to-peer platform protocols are implemented using a 
particular programming language and over a particular transport protocol, the 
implementation is an instance of a peer-to-peer platform binding 220, where the peer-to- 
peer platform protocols are bound to the language and the transport layer. In one 
embodiment, protocol and peer software implementation issues may be defined in 
documents specific to the binding. A binding document describes how the protocols are 
bound to an underlying network transport (such as TCP/IP or UDP/IP) or to a software 
platform such as Java 222 or a native software platform 224 such as UNIX. 

The following describes the transport binding of the peer-to-peer platform 
protocols over TCP/IP including the message wire format of peer-to-peer platform 
endpoint messages over a TCP/IP socket connection according to one embodiment. Each 
TCP/IP message may include a header and a body. In one embodiment, the format of the 
header is: 
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Type Source IP address Source Port Size Option Unused 



The type may include information used to either unicast or multicast the request. 
The type may indicate whether this is a propagate message, a unicast message, an ACK or 
a NACK. The port may allow each peer to decide to bind its transport service to a 
specific port number. The TCP binding preferably does not require that a specific port be 
used. The size may indicate the body size (not including the header). The option may be 
used to specify the kind of socket connections (uni- or bi-directional) in use. The TCP/IP 
binding does not require the maintenance of any states. The normal operation is for one 
peer to send a TCP/IP packet to another one, and to close the socket after the packet is 
sent. This is the minimum functionality required to implement unidirectional pipes. In 
one embodiment, if the receiving end decides to keep the connection active (socket "keep 
alive"), it may return an indicator to the sender to tell the sending end that it is keeping 
the connection alive. The sending end may reuse the same socket to send a new packet. 

The following describes the transport binding of the peer-to-peer platform 
protocols over HTTP including the wire message format for the HTTP binding of the 
peer-to-peer platform protocols. An HTTP request format message may include a header 
and a body using an HTML format. For example: 

<HTML> 

<Code> Header </Code> 

<Msg> Body </Msg> 
</HTML> 

The header allows the receiving end to determine which message type is received. 
Message types may include request succeeded, request failed, empty (no body) and 
response (the body is not empty and contains data). The body may be represented as a 
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string in the HTML request document. Connection states that may be used include, but 
are not limited to: 

• Peer Connection: Before a message can be sent to a HTTP server peer, the HTTP 
client may be required to send a request for connection to the other peer. The 
request for connection message may use the empty header type. The message may 
be sent using a GET request to the following server URL: http://ip- 
name:port/reg/client-peerid/. ip-name specifies the IP of the server peer and the 
port is the corresponding server port number (8080 for example). The server 
replies with an empty message containing either a request succeeded or request 
failed header type. The peer connection message may be used to create a client 
session on the receiving peer. The receiving peer may decide to reject the 
connection and refuse the client connection. This corresponds to a client 
registration. 

• Message Sending: To send a message to another peer server, the client sends a 
message of the response type with a message body part. The server replies with an 
ok or failed message. The message is sent to the following URL using the PUT 
method: http://ip-name:port/snd/. The server replies with a message including a 
request succeeded or request failed header type. 

• Message Retrieving: To retrieve messages from a peer server, the client may send 
a GET request message with the empty header tag to the following URL: 
http://ipname:port/rec/client-peerid/. The server replies with may respond with a 
"message failed" message or with a Content message including the messages 
retrieved. 

Peer Discovery Protocol 

In one embodiment, the peer-to-peer platform may include a peer discovery 
protocol that may allow a peer to find advertisements on other peers. The peer discovery 
protocol may be used to discover any published peer resources including other peers, peer 
groups, pipes, services and any other resource that has an advertisement in the peer-to- 
peer network. This protocol may be used to find members of any kind of peer group, 
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presumably to request membership. In one embodiment, the peer discovery protocol is 
the default discovery protocol for all peer groups, including the world peer group. The 
discovery protocol may be used as a default discovery protocol that allows all peer-to- 
peer platform peers to understand each other at a very basic level. 

The peer discovery protocol may provide, at the lowest level, the minimum 
building blocks for propagating discovery requests between peers. Thus, the peer 
discovery protocol may provide the essential discovery infrastructure for building high- 
level discovery services. In many situations, discovery information is better known by a 
high-level service, because the service may have a better knowledge of the topology 
(firewall traversal), and the connectivity between peers. The peer discovery protocol may 
provide a basic mechanism to discover advertisements while providing hooks so high- 
level services and applications can participate in the discovery process. Services may be 
able to give hints to improve discovery (i.e. decide which advertisements are the most 
valuable to cache). 

In one embodiment, the peer discovery protocol may be based on web crawling 
and the use of rendezvous peers. Rendezvous peers are peers that offer to cache 
advertisements to help others peers discover resources, and propagate requests they 
cannot answer to other known rendezvous peers. Rendezvous peers and their use in the 
discovery process are discussed later in this document. 

In one embodiment, custom discovery services may choose to leverage the peer 
discovery protocol. If a peer group does not have its own discovery service, the peer 
discovery protocol is preferably used as the method for probing peers for advertisements. 
Rendezvous peers may keep a list of known peers and peer groups. This list may or may 
not be exhaustive or timely. A custom discovery service (if it knew that the region's 
rendezvous did keep a timely exhaustive list), for example, may discover all peers in the 
region by sending a single message to the rendezvous peer. 
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In one embodiment, peer discovery may be done with, or alternatively without, 
specifying a name for the peer to be located and/or the group to which peers belong. 
When no name is specified, all discovered advertisements of the requested type may be 
returned. If a probing peer provides the name of the peer to be located, a simple 
translation may be requested that returns that peer's advertisement. Once a peer is 
discovered, ping, status, and capability messages may be sent to its "main" endpoint(s) 
using a peer information protocol. Peers may export more than one endpoint. Preferably, 
each peer designates at least one primary endpoint to handle the low-level housekeeping 
protocols such as the peer discovery protocol and the peer information protocol. 



Li one embodiment, the peer discovery protocol may be used to probe network 
peer groups looking for peers that belong to specified peer groups. This process may be 
referred to as screening. Peers may be screened for membership by presenting each 
candidate member with a peer group name (string matched with the peer group 
5 5 15 advertisement canonical name). Preferably, peers claiming to belong to this group may 
IR respond, while other peers do not respond. The peer discovery protocol may be used to 

I "". discover any type of core advertisement including, but not limited to: peer 

advertisements, peer group advertisements, pipe advertisements and service 
advertisements. 



Peer groups need customizable and adaptable discovery policies. In one 
embodiment, the peer-to-peer platform may be policy-agnostic, and may only provide the 
basics for discovery. The basics may include one or more core discovery protocols 
including, but not limited to, a propagate protocol (broadcast within a scope range (subnet 
25 or peer group members)), a rendezvous protocol (unicast to a trusted discovery peer) and 
an invite protocol (reverse discovering). 

A discovery policy may be implemented in a discovery service based on the core 
discovery protocol. In one embodiment, a discovery service in the core peer-to-peer 
30 platform may be used to discover abstractions and/or entities in the peer-to-peer network 



Atty. Dkt. No.: 5681-07400/ P7109 



Conley Rose & Tayon, P.C 



including, but not limited to, peers, peer groups, peer group policies (group defined 
services) and pipe endpoints. 



In some embodiments of a peer-to-peer platform, the discovery service may rely 
5 on trusted peers (discovery proxies). The discovery service may leverage local neighbors 
(local propagate). The discovery service may use rendezvous peers (indexes). The 
discovery service may leave traces in discovery proxies (cache). The discovery service 
may use net crawling as a last resort (propagate between trusted discovery proxies). In 
one embodiment, a discovery service may not discover some entities in the peer-to-peer 
10 network including, but not limited to, content (large scale; in one embodiment, a content 
management service may be used for content discovery), metadata (maintain relationship 

5 ^ between data), users, and applications. 

Q 

il Embodiments of a peer-to-peer platform discovery service may leverage 

15 surrounding peers and peer groups, provide meetings points for far away peers and 
!;| groups, use an asynchronous protocol and provide reverse discovery. The discovery 

service preferably may be used to find new neighbor peers and provide the ability for a 
peer to learn about other peer's abilities. Embodiments of a discovery service in the peer- 
to-peer platform may provide extensibility, spontaneous configuration, adaptive 



Fll 

B 

Q 20 connectivity, a dynamic (i.e. no fixed) network topology, and the ability to reach the 
"edge of the Internet" (firewall, and NAT). 



Embodiments of a discovery method in the peer-to-peer platform preferably do 
not require centralized naming (e.g. no DNS). A discovery service preferably may 

25 provide predefined meeting points that may be used in platform bootstrapping. The 
discovery service preferably may support a dynamic environment (peers may come and 
go). The discovery service preferably may support an unreliable environment (peers may 
fail). The discovery service preferably may help to adapt to a changing environment 
through viral behavior. The discovery service preferably may be used to improve 

30 performance as a system ages (increase locality). The discovery service preferably may 
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be used in support of security (change of physical location). The discovery service 
preferably may be used that provides administrationless discovery (zero-admin). 

Embodiments of the peer-to-peer platform discovery service may allow a peer to 
learn about other peers that discover it. In one embodiment, the peer-to-peer platform 
discovery service may provide application-managed rendezvous. In one embodiment of 
the peer-to-peer platform, a peer discovery protocol may support a discovery query 
message and a discovery response message to be used in the peer discovery process. 

Peer groups need customizable and adaptable discovery policies. One approach to 
implementing a discovery policy is to start simple and build more complex policies. 
Embodiments of the peer-to-peer platform discovery service may support discovery 
methods including, but not limited to: 

• Propagate Discovery 

Unicast to predefined rendezvous 

Leverage transport dependent multicast (e.g. IP) 

• Unicast Discovery 

Unicast to known rendezvous for forward propagation 
May be used for reverse Discovery 

The peer-to-peer platform preferably does not mandate exactly how discovery is 
done. Discovery may be completely decentralized, completely centralized, or a hybrid of 
the two. Embodiments of the peer-to-peer platform may support discovery mechanisms 
including, but not limited to: 

• LAN-based discovery. This is done via a local broadcast over the subset. 

• Discovery through invitation. If a peer receives an invitation (either in-band or 
out-of-band), the peer information contained in the invitation may be used to 
discover a (perhaps remote) peer. 
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• Cascaded discovery. If a peer discovers a second peer, the first peer may, with the 
permission of the second peer, view the horizon of the second peer to discover 
new peers, groups, and services. 

• Discovery via rendezvous points. A rendezvous point is a special peer that keeps 
information about the peers it knows about. A peer that can communicate via a 
rendezvous peer, for example via a peer-to-peer protocol pipe, may learn of the 
existence of other peers. Rendezvous points may be helpful to an isolated peer by 
quickly seeding it with lots of information. In one embodiment, a web site or its 
equivalent may provide information of well-known peer-to-peer protocol 
rendezvous points. 

In one embodiment, a peer-to-peer platform web of trust may be used. In a web of 
trust, a peer group creator may select initial discovery proxies, and may delegate to new 
peer members. Any peer, when trusted, can become a discovery proxy. Discovery 
proxies may propagate requests between each other for net-crawling discovery. New 
peers may be untrusted or low-trust peers, and may be typically difficult to find and have 
limited discovery range (this may help protect against misbehaviors and denial of service 
attacks). Trusted members are easier to discover. Peers may increase their discovery 
range as they become more trusted (discovery credential). Some peers may not need to 
discover beyond their initial net peer group range. 

In one embodiment, a peer may go through a proximity network, which also may 
be referred to as a subnet or region, to try to find (discover) surrounding peers. The 
Internet includes the concept of subnets that are physically defined by physical routers 
that define regions in which computer systems are connected to one another. Within one 
of these regions, the peer-to-peer protocol uses multicast or other propagate mechanism to 
find peers. In one embodiment, a propagate discovery mechanism may be provided 
where one peer can propagate a discovery request through a local subnet. Peers that are 
in the subnet may respond to the discovery request. The propagate discovery mechanism 
may provide primarily close range discovery. In one embodiment, only peers that are in 
the same physical subnet (region) may respond. "Propagate" is at the conceptual level. 



Atty. Dkt No.: 5681-07400/ P7I09 



86 



Conley Rose & Tayon, P.C. 



Multicast is implemented by TCP/IP to provide propagate capabilities. Other transports 
may use other methods to implement propagate. For example, Bluetooth provides a 
different implementation of propagate which is not multicast. 

The core discovery protocol may provide a format for a local peer to send a 
propagate message (a request to find information about other peers or peer groups in its 
local region or subnet) and also a format for a response message. A propagate may ask 
who's there (what peers are in the subnet). One or more peers may decide to respond. 
Other peers on the subnet may choose not to respond if they don't want to be discovered 
by the requesting peer. The response message may indicate that a peer is there and that 
the requesting peer may communicate with it if it wants more information. In one 
embodiment, the core peer-to-peer platform may define the format of the discovery 
requests and responses as part of the peer discovery protocol. In one embodiment, the 
messages may be XML messages. 

One embodiment of a peer-to-peer platform may provide a bootstrapping process 
for peers. In one embodiment, a new peer may not know any peers or peer groups when 
bootstrapped. When bootstrapping, the peer may issue a peer discovery propagate 
message. The new peer is looking for one or more peers in the subnet. The new peer 
needs to reach some level of connectivity in order to support higher-level operations. 
From discovered peers, the new peer may acquire information needed to allow the new 
peer to go further in its bootstrapping process. For example, the new peer may send 
messages to another peer requesting information on services that the other peer may be 
aware of that the new peer needs for bootstrapping. 

When the new peer discovers another peer or peers, it may attempt to discover 
peer groups. This process may be similar to the peer discovery process described above. 
The new peer may send (e.g. propagate) another discovery message that is configured to 
discover peer groups. Peers in the proximity network (region) that are aware of a peer 
group or peer groups may respond to the peer group discovery message, and may return 
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information on the peer group(s) (e.g. peer group advertisements) of which they are 
aware. The new peer may use this information to determine a peer group or peer groups 
that it may be interested in joining. 

In one embodiment, a peer group may be configured so that only a subset of peers 
within a group may have the capabilities to respond to peer group discovery messages and 
to provide information about the peer group to inquiring peers. 

Peer and peer group discovery may both be implemented by the peer discovery 
protocol. Peer and peer group discover are more or less at the same level in the P2P 
platform. In one embodiment, peer discovery may use a message that indicates the 
discovery is looking for peers, and peer group discovery may use a similar message that 
indicates the discovery is looking for peer groups. 

In one embodiment, the peer discovery protocol may be required to be 
implemented in a peer platform, and thus all peers will have the service running. When 
one peer sends (e.g. propagates) a request, then a receiving peer must send a response, 
unless it is configured to not respond to at least some requests from at least some peers 
based upon configuration parameters. In another embodiment, peers may be 
implemented without the peer discovery protocol. In other words, in this embodiment, 
peers are not required to implement the peer discovery platform. For example, on some 
smart devices, peer information and/or peer group information may be preconfigured into 
the device, and so bootstrapping may be performed on these devices without having to 
initiate a peer discovery. 

Embodiments of the peer-to-peer platform may implement a discovery mechanism 
that is more suited for long-range discovery than the propagate method described above. 
In one embodiment, rendezvous peers may be used in discovery. A rendezvous peer may 
be described as a meeting point where peers and/or peer groups may register to be 
discovered, and may also discover other peers and/or peer groups, and retrieve 
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information on discovered peers and/or peer groups. In one embodiment, a peer (any 
peer) in a peer group may decide to become or may be appointed or elected as a 
rendezvous peer in the group. The rendezvous peer may be advertised as a meeting point, 
and may be predefined on peers so that, for example, the peers, when starting up, may 
know to go to the rendezvous peer to find information about the peer-to-peer network. 
Rendezvous peers may act as information brokers or centralized discovery points so that 
peers can find information in an easy and efficient manner. As a peer group grows, a 
peer may become a rendezvous peer in the group. In one embodiment, a network of 
rendezvous peers may be constructed that may help to provide long-range discovery 
capabilities. A rendezvous peer may be aware of at least some of the other rendezvous 
peers in the network, and a discovery message from a peer may be forwarded from a first 
rendezvous peer to a second, and so on, to discover peers and/or peer groups that are 
"distant" on the network from the requesting peer. 

Rendezvous peers may offer to cache advertisements to help others peers discover 
resources, and may propagate (forward) requests they cannot answer to other known 
rendezvous peers. Preferably, a rendezvous peer implements at least one of these two 
functions. The services provided by a rendezvous peer may be different than message 
routing. Message routing is performed at a lower level involving multi-hops connections 
to send a message between any peers in the network. In one embodiment, the forwarding 
of a request between two rendezvous peers may involve routing to propagate a request 
between two rendezvous, but this is transparent to the rendezvous service and done 
underneath. 

In one embodiment, rendezvous peers may forward requests between each other. 
A rendezvous may be typically connected to a few other rendezvous peers. There may be 
as many rendezvous peers as peers in a peer group. Not every peer may be a rendezvous 
(e.g. if a peer has no caching capabilities or is isolated behind a firewall). In one 
embodiment, only rendezvous peers may forward a discovery request to another 
rendezvous peer. This restriction may serve to limit and control the exponential growth of 
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request propagations within the network. Rendezvous peers may thus provide a simple 
throttle mechanism to control the propagation of requests. In one embodiment, 
sophisticated rendezvous peers may be deployed to filter and distribute requests for the 
best usage of network resources. 

In one embodiment, a peer may be pre-configured with a pre-defined set of 
rendezvous peers. These bootstrapping rendezvous may help the peer discover enough 
network resources (peers, rendezvous, services) as it needs to support itself. In one 
embodiment, the pre-configured rendezvous are optional. A peer may be able to bootstrap 
itself by finding rendezvous or enough network resources in its proximity environment. 
If a peer does not know the information, it may ask the surrounding peers (hop of 1) if 
they know the answer. One or more peers may already have the answer. If no surrounding 
peers know the answer, the peer may ask its rendezvous peers to find advertisements. 
Peers are recognized as rendezvous peers in their peer advertisements. When a peer 
discovers a new peer, it can determine if this peer is a rendezvous. A peer may not be 
required to use all the rendezvous peers that it has discovered. 

Rendezvous peers may forward requests between themselves. The discovery 
process continues until one rendezvous peer has the answer or the request dies. There is 
typically a Time To Live (TTL) associated with the request, so it is not infinitely 
propagated. As an example, suppose a peer A is attempting to discover a resource R on 
the network. Peer A issues a discovery request specifying the type (peer, peer group, 
pipe, service) of advertisements it is looking for. To initiate the discovery, peer A sends a 
discovery request message as a single propagate packet to all its available endpoints. The 
packet may contain the requested peer advertisement, so the receiving peer can respond to 
the requester. Each discovery request identifies the initiator, and a unique request 
identification specified by the initiator of the request. When another peer receives the 
discovery request (assume peer B in this example), if it has the requested R 
advertisement, it will return to peer A the advertisement for R in a discovery response 
message. If Peer A does not get response from its surrounding peers (hop of 1), Peer A 
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may send the request to its known rendezvous peers. If the rendezvous peers do not have 
the advertisement, they can propagate the request to all other rendezvous peers they 
know. When a rendezvous receives a respond to a request, the rendezvous may cache the 
R advertisement for future usage, before sending it to the requestor. 

In one embodiment, the peer rendezvous capabilities may be embedded in the core 
discovery protocol of the peer-to-peer platform. Rendezvous peers may be protocol- 
based, and may broker more information than name servers that typically only broker 
names of entities. In one embodiment, a rendezvous peer may maintain indexes for 
entities in the peer-to-peer platform including peers, peer groups, and advertisements. 
Indexes may be dynamic indexes which may grow as the peer group community grows 
and more peers join. As a group joins, some peers may decide to become rendezvous 
peers to help peers connect with other peers in the group. 

The rendezvous peer is at the peer level. A rendezvous peer is not a "service". A 
rendezvous peer may be used as part of an infrastructure to construct services such as a 
DNS or other centralizing and index services. In one embodiment, services may interact 
with a rendezvous peer to obtain and/or manipulate information stored on the rendezvous 
peer to perform some task to make the system act more efficiently. 

In a network of peers, some peers may elect themselves, through the discovery 
protocol, to become rendezvous peers. A rendezvous peer may act as a broker or 
discovery message router to route discovery messages to the right place. In other words, a 
rendezvous may act to route discovery requests to the right rendezvous peers. For 
example, a rendezvous peer may receive a message requesting information about peers 
that are interested in baseball. The rendezvous peer may know of another rendezvous 
peer that specializes in information about baseball. The first rendezvous peer may 
forward or route the message to the second rendezvous peer. In one embodiment, 
rendezvous peers may maintain connections to other rendezvous peers in order to provide 
discovery and routing functionality. 
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Rendezvous peers may support long-range discovery. For example, a first peer is 
at a remote location from a second peer. For one of these peers to find the other with a 
mechanism such as web crawling may be time consuming, since there maybe a lot of 
"hops" between the two peers. Rendezvous peers may provide a shortcut for one of the 
peers to discover the other. The rendezvous peer, thus, may serve to make the discovery 
process, in particular long-range discover, more efficient. 

A peer-to-peer network may be dynamic. Peers and peer groups can come and go. 
Dynamic identifiers (addresses) may be used. Thus, routes between peers need to be 
dynamic. Rendezvous peers may provide a method for route discovery between peers 
that allows routing in the peer-to-peer network to be dynamic. In this method, the 
rendezvous peers may perform route discovery for peers when the peers send discovery 
messages to the rendezvous peers or when a peer is attempting to connect to another peer 
or peer group that is not in the local region of the peer. This method may be transparent 
to the requesting peer. 

In one embodiment, the rendezvous peers may be able to cache advertisements. 
An advertisement may be defined as metadata or descriptions of a resource. An 
advertisement may include information necessary for an entity to connect to or use the 
resource, for example a service advertisement may include information for connecting to 
and using the service. Advertisements may be published to allow other entities to 
discover them. The rendezvous peer may provide the ability for services and applications 
to store and cache temporary, e.g. via a lease mechanism, advertisements. This may used, 
for example, when one service needs to connect to another service, and needs the pipe 
endpoint or communication channel that may be used to connect to the service. The pipe 
endpoint may be included in a service advertisement published on a rendezvous peer. 
Thus, in one embodiment, the rendezvous peer provides the ability for peers, peer groups, 
services and applications to advertise pipe endpoints and to discover pipe endpoints of 
services and applications. 
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In one embodiment, the rendezvous protocol may use an index cache (e.g. on a 
peer serving as a rendezvous proxy). Figure 13 illustrates discovery through a 
rendezvous peer according to one embodiment. Rendezvous proxy 206 may cache peer 

5 200 and peer group 210 information for peer groups 21 OA and 21 OB. Peers 200 in each 
peer group 210 may then discover each other through rendezvous proxy 206, 
Rendezvous proxy 206 may itself be a peer and may be a member in one or more peer 
groups 210. In one embodiment, access to rendezvous proxies 206 may be restricted to 
peers with rendezvous access privileges. In this embodiment, non-trusted peers (peers 

10 without access privileges) may access rendezvous proxies 206 through trusted peers 200 
within their peer group 210, or alternatively through other local peers in other peer 
groups. In one embodiment, the rendezvous protocol may be used across subnets 
(configurable at the peer group level). In one embodiment, the rendezvous protocol may 



one embodiment. In one embodiment, discovery proxy 208 may control propagation of 
discovery messages. In Figure 14, discovery proxy 208 may receive discovery messages 



?! 20 from peers 200 in peer group 210A and propagate the messages to peers in other groups 



such as peer group 210B. In one embodiment, access to discovery proxies 208 may be 
restricted to peers with discovery proxy access privileges. In this embodiment, non- 
trusted peers (peers without access privileges) may access discovery proxies through 
trusted peers 200 within their peer group 210, or alternatively through other local peers in 

25 other peer groups. In one embodiment, propagation may be controlled using TTL (time 
to live). In another embodiment, propagation may be controlled using message counts. 
In one embodiment, the propagate policy may be used for subnet TCP/multicast (platform 
configurable). In one embodiment, the propagate policy may support HTTP gateways 
(platform configurable). In one embodiment, the propagate policy may be used through 

30 firewalls (e.g. need peer activation behind firewalls). 




15 



be used across/through firewalls (e.g. gateways). 



In one embodiment, the peer-to-peer platform may include a propagate policy for 
use in discovery. Figure 14 illustrates discovery through propagate proxies according to 
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In one embodiment, the peer-to-peer platform may include an invite policy. In 
one embodiment, the invite policy may support the adding of new peers and peer groups 
(e.g. publish advertisements). 



In one embodiment, the peer-to-peer platform may allow the persistent local peer 
caching of discovery information. In this embodiment, a peer may be allowed to cache 
advertisements discovered via the peer discovery protocol for later usage. Caching may 
not be required by the peer-to-peer platform, but caching may be a useful optimization. 
10 The caching of advertisements by a peer may help avoid performing a new discovery each 
time the peer is accessing a network resource. In a highly transient environment, 
performing the discovery may be necessary. In a static environment, caching may be more 
to efficient. 



15 In one embodiment, the peer-to-peer platform may support trusted discovery 

peers. In one embodiment, the peer-to-peer platform may use discovery credentials. In 
one embodiment, the peer-to-peer platform may allow credential delegation. In one 
embodiment, the peer-to-peer platform may support propagate proxies. In one 
to embodiment, a propagate proxy may support TTL/message counts. TTL stands for Time 

20 To Live (how long the request lives in the system). In one embodiment, a propagate proxy 
may support net crawling. In one embodiment, a propagate proxy may provide "smart 
above" routing. 



In one embodiment, a peer preferably does not initiate a new discovery request 
25 until the minimum allowable interval between discoveries is reached. This limitation on 
the maximum rate of discoveries may be similar to the mechanism required by Internet 
nodes to limit the rate at which ARP requests are sent for any single target IP address. 
The maximum rate may be defined by each specific implementation transport bindings 
and exported to the application. 
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Figure 15 illustrates using messages to discover advertisements according to one 
embodiment. A message or messages may be used to get all known, reachable 
advertisements within a region on the network. This list is preferably not guaranteed to be 
exhaustive, and may be empty. Named peers may also be located using the peer 
discovery protocol. A message may include a peer group credential of the probing 
(requesting) peer that may identify the probing peer to the message recipient. The 
destination address may be any peer within a region (a propagate message 230) or 
alternatively a rendezvous peer (a unicast message 232). The response message 234 may 
return one or more advertisements (e.g. peer advertisements and/or peer group 
advertisements) that may include "main" endpoint addresses which may be converted to a 
string in the standard peer endpoint format (e.g. URI or URL) and also may include a 
network transport name. It is preferably not guaranteed that a response to a query request 
will be made. Preferably, the peer discovery protocol does not require a reliable 
transport. Multiple discovery query requests may be sent. None, one or multiple 
responses may be received. 

In one embodiment, a discovery query message may be used to send a discovery 
request to find advertisements (e.g. for peers or peer groups). The discovery query may be 
sent as a query string (attribute, value) form. A null query string may be sent to match any 
results. A threshold value may be included to indicate the maximum number of matches 
requested by a peer. The following is an example of one embodiment of a discovery query 
message in XML, and is not intended to be limiting: 

<?xml version="1.0" encodmg="UTF-8 M ?> 
<DiscoveryQuery> 

<Credential> Credential </Credential> 

<QuerylD> query id</QueryID> 

<Type> request type (e.g. PEER, GROUP, PIPE, SERVICE, CONTENT) 
</Type> 

<Threshold> requested number of responses </Threshold> 
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<PeerAdv> peer advertisement of requestor </PeerAdv> 
<Attr> attribute </Attr> 
<Value> value </Value> 
</DiscoveryQuery> 

Embodiments of a discovery query message may include, but are not limited to, 
the following fields: 

• Credential: The credential of the sender 

• QueryE): Query identifier 

• Type: specifies which advertisements are returned 

• Threshold: requested number of responses 

• PeerAdv: peer advertisement of requestor 

• Attn specifies the query attribute 

• Value: specifies the query value 

In one embodiment, the value tag is only present if the Attr tag field is present. 
Both the Attr and Value tag may be omitted. 

In one embodiment, a discovery response message may be used to send a 
discovery response message to answer a discovery query message. The following is an 
example of one embodiment of a discovery response message in XML, and is not 
intended to be limiting: 

<?xml version="L0" encoding="UTF-8 M ?> 
<DiscoveryResponse> 

<Credential> Credential </Credential> 

<QueryID> query id</QueryID> 

<fType> request type (e.g. PEER, GROUP, PIPE, SERVICE, CONTENT) 
</Type> 

<Attr> Attribute </Attr> 
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<Value> value </Value> 
<Responses> 

(peer, peer group, pipe, service or content advertisement response) 
</Responses> 

< > 

<Responses> 

(peer, peer group, pipe, service or content advertisement response) 
</Responses> 
</DiscoveryResponse> 

Embodiments of a discovery response message may include, but are not limited 
to, the following fields: 

• Credential: The credential of the sender 

• QuerylD: Query identifier 

• Type: specifies which advertisements are returned 

• Attn specifies the query attribute 

• Value: specifies the query value 

• Responses: advertisement responses. The advertisement may be a peer, peer 
group, pipe, content or service advertisement. 

In one embodiment, the value tag is only present if the Attr tag field is present. 
Both the Attr and Value tag may be omitted. 

In one embodiment, if an XML advertisement document is embedded into another 
XML document, the XML document separators must be dealt with. This may be done 
using the standard XML escaping rules. For example, becomes '<' V becomes 
'>' and becomes '&amp\ 
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Reverse discovery 

Reverse discovery means that, in a peer-to-peer network, when a first entity (e.g. a 
peer) discovers a second entity (e.g. another peer), the second entity may also discover the 
first entity from the discovery initiated by the first entity. This may also be referred to as 

5 "mutual discovery". In most traditional systems, discovery is typically one-directional. 
In the peer-to-peer world, reverse discovery is important because, by definition, all 
"peers" are equal (i.e. it is typically not a hierarchical system). In one embodiment, there 
may be different levels of discovery for peers. For example, a peer may be configured to 
remain anonymous when discovering other peers or to always support reverse discovery. 

10 In one embodiment, a peer initiating a discovery may also be configured to deny 
discovery to another peer if the other peer is configured or chooses to remain anonymous. 
In one embodiment, a peer may also be configured to or may choose to deny discovery by 
other peers that wish to remain anonymous. 



i ;ss 

)b 15 Invitations 



One embodiment of the discovery protocol may also provide methods by which a 
peer can "advertise" itself, for example when joining a peer-to-peer network. For 
example, a peer may send an email message, by telephone, by "traditional" mail, or by 
f U other methods to other peers it discovers or is preconfigured to know about to advertise 

m 

Q 20 its presence and willingness to be contacted by other peers. This is done outside of the 
discovery method, and may be performed by any external medium. A peer who receives 
an invitation from a peer may have a capability to add or enter the new peer to a list or 
database of peers that it knows about. When the peer later restarts, these peers may be 
among the preconfigured peers that the peer knows about. In one embodiment, a peer 
25 may have a "notify" or "invitation" interface to allow a user to initiate invitations. In one 
embodiment, the peer-to-peer platform may provide import and export capabilities for 
invitations. In one embodiment, the invitations may be implemented as documents 
external to the peer-to-peer system that may be exported from one peer and imported into 
another peer. In one embodiment, the invitations may be in a format that enables the 
30 exporting and importing. In one embodiment, the invitations may be in XML format. In 
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one embodiment, an interface may be provided to allow the manual entering of invitation 
information. Importing the invitation may create a peer-to-peer platform document that 
may then be used by the peer. The format of exported documents may depend on the 
platform on which the peer is implemented. 

Peer Resolver Protocol 

In one embodiment, the peer-to-peer platform may include a peer resolver 
protocol that may allow a peer to send preferably simple, generic search queries to one or 
more peer services. In one embodiment, only those peers that have access to data 
repositories and that offer advanced search capabilities typically implement this protocol. 
Each service may register a handler in the peer group resolver service to process resolver 
query requests. Resolver queries may be demultiplexed to each service. Each service may 
respond to a peer via a resolver response message. It is important to point the differences 
between the peer discovery protocol and the peer resolver protocol. The peer discovery 
protocol is used to search for advertisements to bootstrap a peer, and discover new 
network resources. The peer resolver protocol is a generic service that services query 
protocols. The peer resolver protocol may be used by a service on a peer to interact with a 
service on another peer. 

The peer resolver protocol may enable each peer to send and receive generic 
queries to find or search for peer, peer group, pipe or service specific information such as 
the state of a service or the state of a pipe endpoint. Preferably, each resolver query has a 
unique service handler name to specify the receiving service, and a query string to be 
resolved by the service. The peer resolver protocol preferably provides a generic 
mechanism for peers to send queries and receive responses. The peer resolver protocol 
preferably removes the burden for registered message handlers by each service and set 
message tags to ensure uniqueness of tags. The peer resolver protocol preferably ensures 
that messages are sent to correct addresses and peer groups. The peer resolver protocol 
preferably performs authentication and verification of credentials and the dropping of 
rogue messages. Preferably, there is no guarantee that a response to a resolver query 
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request will be made. Preferably, a peer is not required to respond to a resolver query 
request. Preferably, a reliable transport is not required by the peer resolver protocol. In 
one embodiment, multiple resolver query messages may be sent. None, one or multiple 
responses may be received. 

Figure 16 illustrates one embodiment of using peer resolver protocol messages 
between a requesting peer 200A and a responding peer 200B. In one embodiment, a 
resolver query message 236 may be used to send (unicast) a resolver query request to a 
service on another member 200B of a peer group. In one embodiment, the resolver query 
may be sent as a query string to a specific service handler. Preferably, each query has a 
unique identifier. The query string may be any string that may be interpreted by the 
targeted service handler. A resolver response message 238 may be sent (unicast) to the 
requesting peer 200A by the service handler. The following is an example of one 
embodiment of a resolver query message in XML, and is not intended to be limiting: 

<?xml version="1.0" encoding="UTF-8"?> 
<ResolverQuery> 

<Credential> Credential </Credential> 

<HandlerName> name of handler </HandlerName> 

<QueryID> incremental query identifier </QueryID> 

<Query> query string </Query> 
</ResolverQuery> 

Embodiments of a resolver query message may include, but are not limited to, the 
following fields: 

• Credential: The credential of the sender 

• QueryED: Query identifier 

• HandlerName: service the query needs to be passed 

• Query: query string 
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A resolver response message may be returned in response to a resolver query 
message. The following is an example of one embodiment of a resolver response message 
in XML, and is not intended to be limiting: 

<?xml version= M 1.0" encoding= n UTF-8 H ?> 
<ResolverResponse> 

<Credential> Credential </Credential> 

<HandlerName> name of handler </HandlerName> 

<QueryID> query identifier </QueryID> 

<Response> response </Response> 
</ResolverResponse> 

Embodiments of a resolver response message may include, but are not limited to, 
the following fields: 

• Credential: The credential of the sender 

• QueryBD: Query identifier (long as a String) 

• HandlerName: service the query needs to be passed 

• Response: response String 

Peer Information Protocol 

Once a peer is located, its capabilities and status may be of interest. In one 
embodiment, the peer-to-peer platform may include a peer information protocol that may 
allow a peer to learn about other peers' capabilities and status. For example, a peer can 
send a ping message to see if another peer is alive. A peer may also query another peer's 
properties where each property has a name and a value string. Preferably, a peer is not 
required to respond to a peer information protocol request. 

Figure 17 illustrates one embodiment of using peer information protocol messages 
between a requesting peer 200 A and a responding peer 200B. In one embodiment, to see 
if peer 200B is alive (i.e. responding to messages), peer 200A may be sent a ping message 
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240. The ping message 240 may include a destination address that is peer 200B's "main" 
endpoint returned during discovery, for example. The message may also include a group 
membership credential of the requesting peer 200A that may identify the probing peer 
200A to the message recipient 200B. The message may also contain an identifier unique 
to the sender. This identifier is preferably returned in the response message 242. 
Response message 242 may include information about peer 200B, including information 
on the status of the peer 200B. If peer 200B responds with a message 242, this may 
indicate to peer 200A that peer 200B is "alive" and thus currently responding to 
messages. 

In one embodiment, messages may be used to get a list of named control 
"properties" exported by a peer. A property is a "knob" used to get information or 
configuration parameters from the peer. All properties are preferably named (by a string), 
and are preferably "read-only". In one embodiment, higher-level services may offer "read- 
write" capability to the same information, given proper security credentials. Each 
property preferably has a name and a value string. Read-write widgets may allow the 
string value to be changed, while read-only widgets do not. In one embodiment, the peer 
information protocol only gives read access. The destination address is a peer's main 
endpoint that may have been returned in a discovery response message. 

Preferably, a reliable transport is not required by the peer information protocol. In 
one embodiment, multiple peer information messages may be sent. None, one or multiple 
responses may be received. 

In one embodiment, a ping message may be sent to a peer to check if the peer is 
alive and/or to get information about the peer. The ping option may define the response 
type returned. In one embodiment, a full response (peer advertisement) or a simple 
acknowledge response (alive and uptime) may be returned. The following is an example 
of one embodiment of a ping message in XML, and is not intended to be limiting: 
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<?xml version="1.0" encoding="UTF-8"?> 
<Ping> 

<Credential> Credential </Credential> 
<SourcePid> Source Peer identifier </SourcePid> 
<TargetPid> Target Peer identifier </TargetPid> 
<Option> type of ping requested</Option> 
</Ping> 

In one embodiment, a peer information response message may be used to send a 
response message in response to a ping message. The following is an example of one 
embodiment of a peer information response message in XML, and is not intended to be 
limiting: 

<?xml version="1.0" encoding="UTF-8"?> 
<PeerInfo> 

<Credential> Credential </Credential> 

<SourcePid> Source Peer identifier </SourcePid> 

<TargetPid> Target Peer identifier </TargetPid> 

<Uptime> uptime</Uptime> 

<TimeStamp> timestamp </TimeStamp> 

<PeerAdv> Peer Advertisement </PeerAdv> 
</PeerMo> 

Peer Membership Protocol 

In one embodiment, the peer-to-peer platform may include a peer membership 
protocol that may allow a peer to join or leave peer groups, and to manage membership 
configurations, rights and responsibilities. This protocol may allow a peer to obtain group 
membership requirements (such as an understanding of the necessary credential for a 
successful application to join the group), to apply for membership and receive a 
membership credential along with a full group advertisement, to update an existing 
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membership or application credential, and to cancel a membership or an application 
credential In one embodiment, authenticators and/or security credentials may be used to 
provide the desired level of protection. 

In one embodiment, the process of joining a peer group may include obtaining a 
credential that is used to become a group member. In one embodiment, the process of 
joining a peer group may include obtaining a "form" listing the set of requirements asked 
of all group members. In one embodiment, this form may be a structured document (e.g. a 
peer group advertisement) that lists the peer group membership service. 

In one embodiment, the peer membership protocol may define messages 
including, but not limited to, an apply message, a join message, an acknowledgement 
(ACK) message, a renew message, and a cancel message. A peer membership protocol 
apply message may be sent by a potential new group member to the group membership 
application authenticator. The authenticated endpoint is preferably listed in the peer 
group advertisement of every member. In one embodiment, a successful response from 
the group's authenticator may include an application credential and a group advertisement 
that preferably lists, at a minimum, the group's membership service. In one embodiment, 
the apply message may include, but is not limited to, the current credential of the 
candidate group member and the peer endpoint for the peer group membership 
authenticator to respond to with an acknowledgement (ACK) message. 

The following is an example of one embodiment of a peer membership protocol 
apply message in XML, and is not intended to be limiting: 

<?xml version="1.0" encoding="UTF-8"?> 

<MembershipApply> 

<Credential> Credential of requestor </Credential> 
<SourcePid> Source pipe identifier </SourcePid> 
<Authenticator> Authenticator pipe advertisement </Authenticator> 
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</MembershipApply> 

A peer membership protocol join message may be sent by a peer to the peer group 
membership authenticator to join a group. The peer preferably passes an application 
credential (from an apply response ACK message) for authentication purposes. A 
successful response from the group's authenticator preferably includes a full membership 
credential and a full group advertisement that lists, at a minimum, the group's 
membership configurations requested of full members in good standing. The message 
may include a credential (application credential of the applying peer: see ACK message). 
This credential may be used as the application form when joining. The message may also 
include the peer endpoint for the authenticator to respond to with an ACK message. 

The following is an example of one embodiment of a peer membership protocol 
join message in XML, and is not intended to be limiting: 

<?xml version="1.0" encoding='TJTF-8"?> 
<MembershipJoin> 

<Credential> Credential of requestor </Credential> 

<SourcePid> Source pipe identifier </SourcePid> 

<Membersship> membership pipe advertisement </Membership> 

<ddentity> identity</Identity> 
</MembershipJoin> 

A peer membership protocol ACK message is an acknowledge message that may 
be used for both join and apply operations. A peer membership protocol ACK message 
may be sent back by the membership authenticator to indicate whether or nor the peer was 
granted application rights to the peer group if the peer is applying, or full membership to 
the peer group if peer is attempting to join. In one embodiment, an ACK message may 
also be sent in response to peer membership protocol renew messages and cancel 
messages. The message may include a credential (an application or membership 
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credential allocated to the peer by the peer group authenticate*). The message may also 
include a more complete peer group advertisement that may provide access to further 
configurations. In one embodiment, not all configuration protocols are visible until the 
peer has been granted membership or application rights. Some configurations may need 
to be protected. Also, depending on the peer credential, the peer may not have access to 
all the configurations. 

The following is an example of one embodiment of a peer membership protocol 
ack message in XML, and is not intended to be limiting: 

<?xml version="1.0" encoding="UTF-8"?> 

<MembershipAck> 

<Credential> Credential </Credential> 
<SourcePid> Source pipe identifier </SourcePid> 
<Membersship> membership pipe advertisement </Membership> 
<PeerGroupAdv> peer group advertisement </PeerGroupAdv> 
<PeerGroupCredential> credential granted </PeerGroupCredential> 

</MembershipAck> 

A peer membership protocol renew message may be sent by a peer to renew its 
credential (membership or application) access to the peer group. An ACK 
(acknowledgement) message may be returned with a new credential and lease if the new 
is accepted. The renew message may include, but is not limited to, a credential (a 
membership or application credential of the peer) and the peer endpoint to which an ACK 
response message may be sent. 

The following is an example of one embodiment of a peer membership protocol 
renew message in XML, and is not intended to be limiting: 

<?xml version="1.0" encoding="UTF-8"?> 
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<MembershipRenew> 

<Credential> Credential </Credential> 
<SourcePid> Source pipe identifier </SourcePid> 
<Membersship> membership pipe advertisement </Membership> 

</MembershipRenew> 

A peer membership protocol cancel message may be sent by a peer to cancel the 
peer's membership or application rights in a peer group. The message may include, but is 
not limited to, a credential (a membership or application credential of the peer) and the 
peer endpoint to send an ACK message. In one embodiment, an ACK to a cancel may 
include a response status indicating the cancel was accepted. 

The following is an example of one embodiment of a peer membership protocol 
cancel message in XML, and is not intended to be limiting: 

<?xml version="1.0" encoding="UTF-8"?> 

<MembershipCancel> 

<Credential> Credential </Credential> 
<SourcePid> Source pipe identifier </SourcePid> 
<Membersship> membership pipe advertisement </Membership> 

</MembershipCancel> 

Pipe Binding Protocol 

In one embodiment, the peer-to-peer platform may include a pipe binding protocol 
that may allow a peer to find the physical location of a pipe endpoint and to bind a pipe 
advertisement to the pipe endpoint, thus indicating where messages actually go over the 
pipe. A pipe is conceptually a virtual channel between two pipe endpoints (input and 
output pipes) and may serve as a virtual link between two or more peer software 
components (e.g. services or applications). 
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A pipe may be viewed as an abstract, named message queue that supports a 
number of abstract operations such as create, open, close, delete, send, and receive. The 
pipe virtual link (pathway) may be layered upon any number of physical network 
transport links such as TCP/TP. Each end of the pipe may work to maintain the virtual 
link and to reestablish it, if necessary, by binding endpoints or finding the pipe's currently 
bound endpoints. 

Actual pipe implementations may differ, but peer-to-peer platform-compliant 
implementations preferably use the pipe binding protocol to bind pipes to pipe endpoints. 
In one embodiment, during the abstract create operation, a local peer binds a pipe 
endpoint to a pipe transport. In another embodiment, bind may occur during the open 
operation. Unbind occurs during the close operation. In one embodiment, each peer that 
"opens" a group pipe may make an endpoint available (binds) to the pipe's transport. 
Messages are preferably only sent to one or more endpoints bound to the pipe. Peers that 
have not opened the pipe preferably do not receive or send any messages on that pipe. In 
one embodiment, when some peer software wants to accept incoming pipe messages, the 
receive operation may remove a single message in the order it was received, not in the 
order it was sent. In one embodiment, a peek operation may be used as a mechanism to 
see if any message(s) has arrived in the pipe's queue. 

In one embodiment, the pipe binding protocol may define messages including, but 
not limited to, a query message and a response message. In one embodiment, a pipe 
binding protocol query message may be sent by a peer pipe endpoint to find a pipe 
endpoint bound to the same pipe advertisement. The following is an example of one 
embodiment of a pipe binding protocol query message in XML, and is not intended to be 
limiting: 

<?xml version="1.0" encoding="UTF-8"?> 
<PipeBindingQuery> 

<Credential> query credential </Credential> 
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<Peer> optional tag. If present, it may include the peer identifier of the 
only peer that should answer the request. 

</Peer> 

<Cached> true if the reply can come from a cache </Cached> 
<PipeID> pipe identifier to be resolved </PipeID> 
</PipeBindingQuery> 

In one embodiment, the requestor may ask that the information not be obtained 
from a cache. This is to obtain the most up-to-date information from a peer to address 
stale connection. The Peer field specifies a peer identifier. This peer is the one that 
should respond to the query. There is preferably no guarantee that a response to a pipe 
binding request will be made. Preferably, a peer is not required to respond to a binding 
request. Preferably, a reliable transport is not required. In one embodiment, multiple 
binding query messages may be sent. None, one or multiple responses may be received. 

In one embodiment, a pipe binding protocol response message may be sent to the 
requesting peer by each peer bound to the pipe in response to a query message. The 
following is an example of one embodiment of a pipe binding protocol response message 
in XML, and is not intended to be limiting: 

<?xml version="L0" encoding="UTF-8"?> 
<PipeBindingAnswer> 

<Credential> credential </Credential> 

<PipeID> pipe identifier resolved </PipeID> 

<Peer> peer identifier (e.g. URI, URN) where a corresponding endpoint 
(e.g. Input Pipe) has been created </Peer> 

<Found> true: the Input Pipe does exist on the specified peer (ACK) 

false: the Input Pipe does not exist on the specified peer (NACK) 
</Found> 
</PipeBindingAnswer> 
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Endpoint Routing Protocol 

In one embodiment, the peer-to-peer platform may include an endpoint routing 
protocol. The endpoint routing protocol may be used by peers to send messages to router 
peers requesting available routes for sending message(s) to destination peers. 

A peer-to-peer platform network is typically an ad hoc, multi-hops, and adaptive 
network by nature. Connections in the network may be transient, and message routing 
may be nondeterministic. Routes may be unidirectional and change rapidly. Peers may 
appear and leave frequently. Two communicating peers may not be directly connected to 
each other. Two communicating peers may need to use router peers to route messages 
depending on the network topology. For example, the two peers may be on different 
network transports, or the peers may be separated by a firewall or a NAT (Network 
Address Translation) router. A peer behind a firewall may send a message directly to a 
peer outside a firewall. But a peer outside the firewall cannot establish a connection 
directly with a peer behind the firewall. 

The endpoint routing protocol may define a set of request/query messages that is 
processed by a routing service to help a peer route messages to its destination. When a 
peer is asked to send a message to a given peer endpoint address, it may look in its local 
cache to determine if it has a cached route to this peer. If the peer does not find a route, it 
may send a route resolver query message to available peer routers requesting route 
information. A peer may have access to as many peer routers as it can find, or optionally 
a peer may be pre-configured to access certain routers. 

Peer routers provide the low-level infrastructures to route a message between two 
peers in the network. Any number of peers in a peer group may elect themselves to 
become peer routers for other peers. Peers routers offer the ability to cache route 
information, as well as bridging different physical (different transport) or logical (firewall 
and NAT) networks. A peer may dynamically find a router peer via a qualified discovery 
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search. A peer may find out if a peer it has discovered is a peer router via the peer 
advertisement properties tag. 

When a peer router receives a route query, if it knows the destination (a route to 
the destination), it may answer the query by returning the route information as an 
enumeration of hops. The message may be sent to the first router and that router may use 
the route information to route the message to the destination peer. The route may be 
ordered from the next hop to the final destination peer. At any point the routing 
information may be obsoleted, requiring the current router to find a new route. 

The peer endpoint may add extra routing information to the messages sent by a 
peer. When a message goes through a peer, the endpoint of that peer may leave its trace 
on the message. The trace may be used for loop detection and to discard recurrent 
messages. The trace may also be used to record new route information by peer routers. 

In one embodiment, the endpoint routing protocol may provide the last resort 
routing for a peer. More intelligent routing may be implemented by more sophisticated 
routing services in place of the core routing service. High-level routing services may 
manage and optimize routes more efficiently than the core service. In one embodiment, 
the hooks necessary for user defined routing services to manipulate and update the route 
table information (route advertisements) used by the peer router may be provided by the 
endpoint routing protocol. Thus, preferably complex route analysis and discovery may be 
performed above the core by high-level routing services, and those routing services may 
provide intelligent hints to the peer router to route messages. 

Router peers may cache route information. Router peers may respond to queries 
with available route information. Route information may include a list of gateways along 
the route. In one embodiment, any peer may become a router peer by implementing the 
endpoint routing protocol. The following is an example of one embodiment of route 
information in XML, and is not intended to be limiting: 
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<?xml version="1.0" encoding="TJTF-8"?> 

<EndpointRouter> 

<Credential> credential </Credential> 
<Src> peer identifier of the source </Src> 
<Dest> peer identifier of the destination </Dest> 
<TTL> time to live </TTL> 

<Gateway> ordered sequence of gateway </Gateway> 



<Gateway> ordered sequence of gateway </Gateway> 
</EndpointRouter> 

The time-to-live parameter specifies how long this route is valid. The creator of 
the route can decide how long this route will be valid. The gateways may be defined as an 
ordered sequence of peer identifiers that define the route from the source peer to the 
destination peer. The sequence may not be complete, but preferably at least the first 
gateway is present. The first gateway is sufficient to initially route the messages. The 
remaining gateway sequence is preferably optional. 

The endpoint routing protocol may provide messages including, but not limited to, 
a route request message and a route answer message from the router peer. In one 
embodiment, a peer may send a route request message to a router peer to request route 
information. Route information may be cached or not cached. In some cases, the route 
query request message may indicate to bypass the cache content and thus to search 
dynamically for a route. Preferably, it is not guaranteed that a route response will be 
received after a query is sent. The following is an example of one embodiment of a route 
query request message in XML, and is not intended to be limiting: 

<?xml version="1.0" encoding="UTF-8"?> 
<EndpointRouterQuery> 
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<Credential> credential </Credential> 

<Dest> peer identifier of the destination </Dest> 

<Cached> true: if the reply can be a cached reply 

false: if the reply must not come from a cache 
</Cached> 
</EndpointRouterQuery> 

In one embodiment, a router peer may send a route answer message to a peer in 
response to a route information request. The following is an example of one embodiment 
of a route answer message in XML, and is not intended to be limiting: 

<?xml version="1.0" encoding="UTF-8"?> 
<EndpointRouterAnswer> 

<Credential> credential </Credential> 

<Dest> peer id of the destination </Dest> 

<RoutingPeer> Peer identifier of the router that knows a route to DestPeer 
</RoutingPeer> 

<RoutingPeerAdv> Advertisement of the routing peer </RoutingPeerAdv> 
<Gateway> ordered sequence of gateways </Gateway> 



<Gateway> ordered sequence of gateways </Gateway> 
</EndpointRouterAnswer> 

Routing 

A peer-to-peer platform preferably provides a mechanism or mechanisms for 
searching and accessing peers, peer groups, content, services and other information in a 
dynamic topology of peers and peer groups, where peers and peer groups can come and 
go. In one embodiment, peers and peer groups may come and go potentially with limited 
or no control and notification. Peers may connect to a peer-to-peer network through 
various wired and wireless protocols, including "not connected" protocols such as may be 
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used by mobile consumer devices such as pagers and PDAs. Peers may also have to cross 
boundaries, for example boundaries created by firewalls and NAT (Network Address 
Translation) routers, to connect to other peers. 

An application that supports the peer-to-peer platform preferably is able to help in 
routing and discovering. Some of the information needed to accomplish routing and 
discovering may be only known by the application. For example, the application may 
support a special type of data as content, and so the application may best "know" how to 
discover items of this special content. Also, the application may have a better knowledge 
of the topology (related to the nature of the application and/or peer group) than the core 
peer-to-peer platform. 

In one embodiment, in order to bootstrap the system, and also in order to have a 
fallback mechanism if an application cannot or does not support one or more of the tasks, 
the core peer-to-peer protocols may provide a discovery and router mechanism for 
discovering peers and other core abstractions such as advertisements, pipes, and peer 
groups. The discovery and routing mechanism of the peer-to-peer platform preferably 
uses as few protocols as possible, is simple, and makes use of underlying optimizations 
when available. Hooks into the core discovery and router mechanism may be provided so 
that applications and services may participate in the discovery and router mechanisms, for 
example, by passing information to the core discovery and router mechanism. In one 
embodiment, an application or service may be allowed to override the core discovery and 
router mechanism with its own custom mechanism. 

In one embodiment, the core discovery and router mechanism may be based on 
web crawling. Web crawling may be well suited for use in self-organizing networks such 
as peer-to-peer networks. In one embodiment, peers may be configured to participate or 
not to participate in the discovery and router mechanism, and may be configured as to the 
level of involvement in the process In one embodiment, a peer may decide whether to 
participate in a discovery or routing task depending on the peer's configuration in the 
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peer-to-peer network. In one embodiment, the configuration may be determined using an 
automated detection of the position of the peer on the network and a network 
configuration wizard tooL 

Web crawling may not create bottlenecks such as may be created by the 
mechanism of a client knowing a server and always going to the same server to find and 
retrieve information (e.g. DNS, NFS etc.). Even if a server is replicated, like DNS, it is 
still a centralized server. If all the known instances of the server are not reachable, a 
client may lose access to the server, even if another (but unknown) server is, indeed, 
available. In a point-to-point network, the information a peer is looking for is generally 
"close by" or may eventually be "close by", so web crawling may not go too far. 

Figure 18 illustrates several core components and how they interact for discovery 
and routing according to one embodiment. Application 300 may use discovery 308 to 
find peers, peer groups, advertisements, and other entities on the peer-to-peer network, 
and may also publish pipe, peer, peer group, service, and other advertisements for access 
by other peers, applications and services on the peer-to-peer network. In one 
embodiment, the endpoint 310 may be responsible for exchanging messages between 
peers that are directly "connected" to each other (i.e. the peers can reach each other 
without any routing and/or discovering). When available, multicast may be used to 
discover peers that the endpoint can reach (multicast is a mechanism which has been 
introduced in IP in order to optimize this kind of process). In addition to that, or when 
multicast is not available, A rendezvous and invitation mechanism may also be provided. 
The rendezvous and invitation method may be used, for example, if multicast is not 
available. For example, HTTP does not provide multicast capabilities. 

The endpoint router 312 may manage a cache of routes, for example routes to 
remote peers. In one embodiment, the endpoint router 312 may be configured from 
caching no routes to caching all routes it is aware of, depending on what the configuration 
wizard has decided with user control. The endpoint router 312 may also forward (route) 
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messages depending on what is found in the cache, and what has been configured. For 
instance, the endpoint router 312 may be configured to route search (propagate) requests 
or to not route the requests. 

In one embodiment, the generic resolver 308 is a protocol that implements a sort 
of RPC (query/response) protocol on top of the endpoint 310. Discovery 306 and pipe 
resolver 304 may use the generic resolver. In one embodiment, discovery 306 may be 
responsible for searching, caching and generating core advertisements (e.g. peer, peer 
group, and pipe advertisements). Discovery 306 may use the generic resolver 308 to send 
query messages and to receive answers. In one embodiment, discovery 306 may be aware 
of rendezvous peers and may have an invitation mechanism that may be used to assist the 
generic resolver 308. In one embodiment, the pipe resolver 304 may be responsible for 
localizing the receiving end of a pipe 302 given a pipe advertisement. In one 
embodiment, the pipe resolver 304 does not search for a pipe advertisement. In one 
embodiment, the pipe resolver 304 may be configured to manage a cache of the locations 
of the receiving ends (i.e. receiving peers) of the pipe 302. 

The pipe protocol may use the endpoint 310 for transferring messages (with the 
potential help of the endpoint router 312) between the sending end of the pipe 302, and 
the receiving end of the pipe 302. In one embodiment, a pipe 302 may be viewed as an 
endpoint 310 that has not been bound to a particular peer. In one embodiment, a pipe 302 
may be moved seamlessly from one peer to another. In one embodiment, a pipe 302 may 
also provides uniqueness that may not be provided by an endpoint 310 since a pipe 
identifier is unique in time and space, and an endpoint 310, being a network address, may 
not be. 

A discovery and router mechanism based on web crawling may be time- 
expensive, and higher level protocols (such as applications) may have information that 
the core is not aware of that may help in the web crawling process. In one embodiment, 
to enable applications to participate in the process, components of the core mechanism 
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may provide hooks that enable the applications to assist in the process (e.g. by providing 
information). Some transport protocols such as HTTP may be configured for and/or 
dynamically learn about web rendezvous peers it can use. An application may be 
provided access to the list of rendezvous peers. In one embodiment, an application may 
be allowed to set/unset routes in an endpoint router 312. Each route may be qualified to 
route or not route propagate messages such as web crawling messages and/ or unicast 
messages. The endpoint router 312 may be viewed as a route cache manager, which is 
may be controlled by an endpoint 310 and/or other entities that may need to control it. In 
one embodiment, an endpoint router 312 may be able to discover unknown routes from 
applications. In one embodiment, discovery 308 may be configured (statically and/or 
dynamically) to control the nature and the amount of data that it manages. In one 
embodiment, discovery 308 may be taught where to go search, or where not to go search. 
In one embodiment, discovery 308 may make an "upcall" to a search/retrieve mechanism. 
In one embodiment, a pipe resolver 304 may manage a cache of input pipes (receiving 
ends). In one embodiment, pipe resolver 304 may be accessed by applications to 
set/unset entries in the cache. 

Router (Relay) peers 

Figure 19 illustrates one embodiment of message routing in a peer-to-peer 
network that uses the peer-to-peer platform. Peers 200 in peer groups 210A and 210B 
may communicate with each other through one or more router peers 244 (also referred to 
as relay peers). In one embodiment, message routing may route messages to 
"unreachable" peers, i.e. may allow messages sent from a peer 200 to reach peers 200 that 
are otherwise unreachable. Networks may be partitioned by firewalls, NAT (Network 
Address Translation) routers, etc. Message routing may allow messages to be delivered 
in partitioned networks. Message routing may also allow peers 200 separated by one or 
more partitions to participate in the same peer group(s) 210. Message routing preferably 
provides optimized message delivery, for example by optimizing routes between peers 
200. Message routing preferably allows for an adaptive peer-to-peer network (e.g. peers 
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may move to remote locations and still receive messages). Message routing preferably 
provides load balancing. In one embodiment, any peer may be a router peer 244. 

One embodiment may provide for HTTP routing servers. In one embodiment, 
HTTP routers may provide for message routes that traverse firewalls. In one 
embodiment, HTTP routers may provide NAT support. In one embodiment, HTTP 
routers may act as message gateways (TTL). TTL stands for Time To Live (how long the 
request lives in the system). 

The widespread use of NAT (Network Address Translation) and firewalls may 
affect the operation of many P2P systems. It also may affect the peer-to-peer platform. In 
particular, a peer outside a firewall or a NAT gateway cannot discover peers inside the 
firewall or the NAT gateway. In the absence of getting system administrators to let the 
peer-to-peer platform traffic through (say by opening a special incoming port at the 
firewall or gateway), possible methods to deal with this problem include, but are not 
limited to: 

• In one embodiment, peers inside firewalls may be asked to initiate connections to 
peers outside the firewall. 

• In one embodiment, peer nodes may be set up that operate like mailbox offices 
where traffic to a peer inside the firewall is queued up to be picked up at a 
designated relay peer outside the firewall. The peer inside the firewall can initially 
reach outside the firewall, select a relay peer, and widely advertise this fact. Later, 
it can periodically contact the relay peer to retrieve messages. 

One embodiment of the peer-to-peer platform may provide router peers. The 
router peers may be at a lower level than rendezvous peers. The router peers may provide 
"pure" message routing. By looking at the destination and source addresses, the router 
peer may determine where a message needs to be sent. In one embodiment, a router peer 
may call or access a rendezvous peer to "discover" information about peers, etc. In other 
words, the router peer may access information from a rendezvous peer to use the 
information in routing messages. 
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In one embodiment, router peers may provide the lowest message routing layer in 
the peer-to-peer platform. Routing may involve complex topologies. For example, the 
routing peers may provide a method to route across a firewall, particularly from peers 
outside the firewall to peers inside the firewall. A peer cannot send a message directly to 
another peer behind a firewall, since by definition there may be no direct route from a 
peer outside the firewall to a peer inside the firewall. A router peer may route messages 
to a gateway peer (a mailbox server where messages for peers behind the firewall may be 
temporarily stored). In one embodiment, the gateway peer may be a router peer acting as 
a gateway. The peers behind the firewall may periodically poll the mailboxes provided 
by the gateway peer to determine if someone has tried to contact them (i.e. are there any 
messages in my mailbox?). Note that a "pipe" provides an abstraction at a higher level 
than the message routing provided by router peers, and thus, a pipe may be an abstraction 
across the network topology between peers, for example peers on opposite sides of a 
firewall, through which the peers may communicate. At the lowest level, one or more 
router peers may discover and establish the actual communications route between the 
peers. This level, however, may be transparent to the peers, who only "see" the pipes. 

In one embodiment, a router peer may build a route table. The router peer may 
keep information about routes that it discovers and store them in the route table. This 
allows the router peer to build a knowledge base (the route table) about the network 
topology as more messages flow on the system. This information may be used by the 
router peer to discover and establish optimal routes between entities in the network, and 
may increase its ability to reach other peers. 

A router peer may access another router peer it is aware of to get route 
information. The route information may be described as a stacked set of destinations (and 
the routes to the destinations). In one embodiment, the information the router peer stores 
on a particular route may be incomplete, because the router peer may only know about the 
route up to a certain point. For example, the router peer may know about a first portion 
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of a route up to another router peer, which knows about the next portion of the route, and 
so on. 

In one embodiment, each peer has a unique peer identifier that is independent of, 
and is not assigned to, fixed addresses. Peers may move around. Therefore, the peer-to- 
peer network topology may be dynamic, and may change every time a peer goes away or 
moves. Thus, the routing method provided by the router peers is preferably dynamic to 
support the dynamic topology. When a peer moves and reconnects, the peer is recognized 
as the same peer that was previously connected elsewhere in the network. This process 
may use the unique identifier of the peer to indicate that the peer is the same one that was 
previously connected elsewhere. In one example, when a peer moves, it may go through 
a discovery process to discover peers and rendezvous peers in its new local subnet or 
region. If the peer wishes to join a peer group that it used at its previous location, it may 
then attempt to discover other peers that have knowledge of the peer group or other peers 
in the peer group. The message may be passed through several router peers until it may 
reach a router peer that has knowledge about the peer group (e.g. a route to the peer 
group) to return to the requesting peer. For example, a user with a laptop may fly from a 
home office to another city. When the user connects to the network in the other city, a 
route may be established, through the services provided by router peers, to the home 
office network peer group. The user may then access email and other services provided 
by the peer group. From the user's standpoint, this process may seem automatic. For 
example, the user may not be required to "dial in" or connect remotely to an ISP to access 
the office as is required in typical networks using static addressing. 

In one embodiment, when a peer becomes a router peer, it may access a stored 
route table as a starting point. In one embodiment, the peer may start from scratch with 
an empty route table. In one embodiment, the peer, when it becomes a router peer, may 
initiate a discovery of other router peers and/or rendezvous peers to get as much 
connectivity information to key peers in the network as possible. 
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In one embodiment, every peer may have knowledge of at least one router peer. 
In one embodiment, there may be a "universal router" that many or all peers may be 
aware of that may be accessed when a peer cannot find anyone. The universal router may 
be able to put the peer into contact with somebody (e.g. another peer) to help in the 
bootstrapping process. 

Security 

The security requirements of a P2P system are very similar to any other computer 
system. The three dominant requirements are confidentiality, integrity, and availability. 
These translate into specific functionality requirements that include authentication, access 
control, audit, encryption, secure communication, and non-repudiation. Such 
requirements are usually satisfied with a suitable security model or architecture, which is 
commonly expressed in terms of subjects, objects, and actions that subjects can perform 
on objects. For example, UNIX has a simple security model. Users are subjects. Files are 
objects. Whether a subject can read, write, or execute an object depends on whether the 
subject has permission as expressed by the permissions mode specified for the object. 
However, at lower levels within the system, the security model is expressed with integers, 
in terms of UID, GID, and the permission mode. Here, the low-level system mechanisms 
do not (need to) understand the concept of a user and do not (need to) be involved in how 
a user is authenticated and what UID and GID they are assigned. 

In one embodiment, the peer-to-peer platform protocols may be compatible with 
widely accepted transport layer security mechanisms for message-based architectures 
such as Secure Sockets Layer (SSL) and Internet Protocol Security (IPSec). However, 
secure transport protocols such as SSL and IPSec only provide the integrity and 
confidentiality of message transfer between two communicating peers. In order to provide 
secure transfer in multi-hops network, a trust association may be established among all 
the intermediary peers. Security is compromised if anyone of the communication links is 
not secured. 
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The peer-to-peer platform security model may be implemented to provide a P2P 
web of trust. The web of trust may be used to exchange public keys among its members. 
Each peer group policy may permit some members to be trusted to the extent that they 
have the authority to sign public keys for other members as well as to do things like 
authenticate, add new members, and remove or revoke membership. 

Embodiments may implement security classes for the RSA public key exchange, 
the RC4 byte stream cipher, and the SHA-1 hash algorithm, among others. These classes 
may enable privacy by the means of a P2P TLS implementation; integrity with signed 
hashes; non-repudiation using the web of trust; and MACs for data authenticity. 
Combinations of these classes may form security suites, and the peer-to-peer platform 
provides the mechanism to add new customized suites as required. 

In some embodiments, for peer group authentication a separate Pluggable 
Authentication Module (PAM) may be provided. Embodiments may provide anonymous 
or guest login, and login with user name and password. A login session may be in clear or 
cipher-text as per the peer group security policy. 

The security module may be available to the core level, and thus services, 
applications and advanced services and applications may plug in their own security 
components and protocols. For example, the web of trust may be defined by a policy that 
requires authorized peer group members to be well-known certificate authorities, and that 
peers exchange X509v3 CA signed certificates. 

Given that the peer-to-peer platform is defined around the concepts of peers and 
peer groups, one embodiment may include a security architecture in which peer IDs and 
group IDs are treated as low-level subjects (just like UID and GID), codats are treated as 
objects (just like files), and actions are those operations on peers, peer groups, and codats. 
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The term "codat" as used herein refers to any computer content - code, data, 
applications, or other collection of computer representable resources. The peer-to-peer 
protocol preferably does not distinguish among different types of resources that can be 
stored on a computer and shared among peers in a peer group. Examples of "codat" 
include text files, photographs, applets, executable files, serialized Java objects, SOAP 
messages, etc. Codats are the elementary unit of information that is exchanged among 
peers. In this embodiment, given that codats may have arbitrary forms and properties, it 
may not be clear what sets of actions should be defined for them. In one embodiment, the 
codats may cany or include definitions of how they should be accessed. Such codats are 
analogous to objects, which define for themselves access methods others can invoke. 

One or more of several other characteristics of the peer-to-peer platform may 
further affect the security requirements of the peer-to-peer platform. In one embodiment, 
the peer-to-peer platform may be focused on mechanisms and not policy. For example, 
UUIDs are used throughout, but they by themselves have no external meaning. Without 
additional naming and binding services, UUIDs are just numbers that do not correspond 
to anything like a user or a principal. Therefore, the peer-to-peer platform preferably does 
not define a high-level security model such as information flow, Bell-LaPadula, or 
Chinese Wall. In one embodiment, when UUIDs are bound to external names or entities 
to form security principals, authenticity of the binding may be ensured by placing in the 
data field security attributes, for example, digital signatures that testify to the 
trustworthiness of the binding. Once this binding is established, authentication of the 
principal, access control based on the principal as well as the prevailing security policy, 
and other functions such as resource usage accounting may be performed. 

The peer-to-peer platform is preferably neutral to cryptographic schemes and 
security algorithms. As such, the peer-to-peer platform preferably does not mandate any 
specific security solution. In such cases, a framework may be provided where different 
security solutions can be plugged in. In one embodiment, hooks and placeholders may be 
provided so that different security solutions may be implemented. For example, every 
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message may have a designated credential field that may be used to place security-related 
information. In one embodiment, exactly how to interpret such information is not defined 
in the peer-to-peer platform, and may be left to services and applications. 

In one embodiment, the peer-to-peer platform may sometimes satisfy security 
requirements at different levels of the system. To allow maximum flexibility and avoid 
redundancy, the peer-to-peer platform preferably does not force a particular 
implementation on developers. Instead, preferably, enhanced platforms based on the 
peer-to-peer platform may provide the appropriate security solutions to their targeted 
deployment environment. To illustrate the last point, two security concerns 
(communications security and anonymity) are examined. 

Peers communicate through pipes. As an example, suppose both confidentiality 
and integrity in the communications channel are desired. In one embodiment, Virtual 
Private Networks (VPNs) may be used to move all network traffic. In one embodiment, a 
secure version of the pipe may be created, similar to a protected tunnel, such that any 
message transmitted over this pipe is automatically secured. In one embodiment, regular 
communications mechanisms may be used, and specific data payloads may be protected 
with encryption techniques and digital signatures. Embodiments of the peer-to-peer 
platform may accommodate one or more of these and other possible solutions. 

Anonymity does not mean the absence of identity. Indeed, sometimes a certain 
degree of identification is unavoidable. For example, a cell phone number or a SIM card 
identification number cannot be kept anonymous, because it is needed by the phone 
company to authorize and set up calls. As another example, the IP number of a computer 
cannot be hidden from its nearest gateway or router if the computer wants to send and 
receive network traffic. In general, anonymity can be built on top of identity, but not vice 
versa. There may be multiple ways to ensure anonymity. In the examples above, it is 
difficult to link a prepaid SIM card sold over the retail counter for cash to the actual cell 
phone user. Likewise, a cooperative gateway or router may help hide the computer's true 
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IP address from the outside world by using message relays or NAT (Network Address 
Translation). 

In one embodiment, a peer-to-peer platform-based naming service may bind a 
peer to a human user. The user's anonymity may be ensured through the naming service, 
or the authentication service, or a proxy service, or any combination of these. The peer-to- 
peer platform is preferably independent of the solution chosen by a particular application. 

At many places, the peer-to-peer platform is preferably independent of specific 
security approaches. In one embodiment, the peer-to-peer platform may provide a 
comprehensive set of security primitives to support the security solutions used by various 
peer-to-peer platform services and applications. Embodiments of the peer-to-peer 
platform may provide one or more security primitives including, but not limited to: 

• A simple crypto library supporting hash functions (e.g., MD5), symmetric 
encryption algorithms (e.g., RC4), and asymmetric crypto algorithms (e.g., Diffie- 
Hellman and RS A). 

• An authentication framework that is modeled after PAM (Pluggable 
Authentication Module, first defined for the UNIX platform and later adopted by 
the Java security architecture). 

• A simple password-based login scheme that, like other authentication modules, 
can be plugged into the PAM framework. 

• A simple access control mechanism based on peer groups, where a member of a 
group is automatically granted access to all data offered by another member for 
sharing, whereas non-members cannot access such data. 

• A transport security mechanism that is modeled after SSL/TLS, with the 
exception that it is impossible to perform a handshake, a crypto strength 
negotiation, or a two-way authentication on a single pipe, as a pipe is 
unidirectional. 
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The demonstration services called InstantP2P and CMS (content management 
service) also make use of additional security features provided by the underlying 
Java platform. 



In one embodiment, peers, configurations, peer groups, and pipes form the 
backbone of the peer-to-peer platform. Security in some embodiments of the peer-to-peer 
platform may use credentials and authenticators (code (e.g. computer-executable 
instructions) that may be used to receive messages that either request a new credential or 
request that an existing credential be validated). A credential is a token that when 
presented in a message body is used to identify a sender and can be used to verify that 
sender's right to send the message to the specified endpoint and other associated 
capabilities of the sender. The credential is an opaque token that must be presented each 
time a message is sent. The sending address placed in the message envelope may be 
crosschecked with the sender's identity in the credential. In one embodiment, each 
credential's implementation may be specified as a plug-in configuration, which allows 
multiple authentication configurations to co-exist on the same network. 

Preferably, all messages include, at a minimum, a peer group credential that 
identifies the sender of the message as a full member peer in the peer group in good 
standing. Membership credentials may be used that define a member's rights, privileges, 
and role within the peer group. Content access and sharing credentials may also be used 
that define a member's rights to the content stored within the group. 

In one embodiment, the peer-to-peer platform may provide different levels of 
security. In one embodiment, APIs may be provided to access well known security 
mechanisms such as RCA. In one embodiment, the peer-to-peer platform may provide a 
distributed security mechanism in a peer-to-peer environment. In one embodiment, this 
distributed security may not depend on certificates administered by a central authority. 
The distributed security mechanism may allow a peer group "web of trust" to be 
generated. In the distributed security mechanism, peers may serve as certificate 
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authorities (security peers). Each peer group may include one or more peers that may 
serve as a certificate authority in the group. In one embodiment, the creator of a peer 
group may become the default security authority in the group. In one embodiment, if 
there is more than one creator, the creator peers may choose one of the peers to be the 
security authority in the group. In one embodiment, the peer or peers that create a peer 
group may define the security methods that are to be used within the group (anywhere 
from no security to high levels of security). In one embodiment, more than one peer in a 
peer group may serve as a security peer. Since peers are not guaranteed to be up at all 
times, having multiple security peers in a peer group may help insure that at least one 
security peer is available at all times. In one embodiment, the peer group's certificate 
peer may verify keys to provide a weak level of trust. In one embodiment, peer-to-peer 
platform advertisements may include information to describe the security mechanism(s) 
to be used in a peer group. For example, the advertisement may include information to 
do public key exchange, information to indicate what algorithms are to be used, etc. The 
advertisement may also include information that may be used to enforce secure 
information exchange on pipes (e.g. encryption information). 

In one embodiment, peer group security may establish a "social contract". The 
role of security is distributed across peer groups, and across members of peer groups, that 
all agree to participate by the rules. A peer group may establish the set of rules by which 
security in the group is enforced. A peer may join the peer group with a low level of 
security clearance (low trust). If the peer stays in the group and behaves (follows the 
rules), the peer may build up its level of trust within the group, and may eventually be 
moved up in its security level. Within peer groups operating under a social contract, 
certificates and/or public keys may be exchanged without the participation of a strict 
certificate authority; i.e. the members may exchange certificates based upon their trust in 
each other. In one embodiment, a peer group may use an outside challenge (e.g. a secret 
group password) that may be encrypted/decrypted with public/private keys, as a method 
to protect and verify messages within the group. In one embodiment, peer groups may be 
configured to use other types of security, including a high level of security, for example 
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using a strict certificate authority, and even no security. In one embodiment, peer-to-peer 
platform messages exchanged within a group may have a "placeholder" for security 
credentials. This placeholder may be used for different types of credentials, depending 
upon the security implementation of the particular group. In one embodiment, all peer-to- 
5 peer messages within the group may be required to have the embedded credential. One 
embodiment may support private secure pipes. 



Peer-to-peer platform Firewalls and Security 

The peer-to-peer platform may provide one or more methods for traversing 
10 firewalls. Figure 20 illustrates traversing a firewall 248 in a virtual private network when 
access is initiated from outside only according to one embodiment. Peers 200 on either 
side of the firewall 248 may each belong to one or more peer groups. In one embodiment, 
entry may be restricted to peers 200 with access privileges. In this example, peers 200A 
and 200B have access privileges, but peer 200C does not. Thus, peers 200A and 200B 
15 may access peers 200D and 200E through firewall 248. In one embodiment, HTTP 



|«4 



\M "tunnels" may be used, with proxies 246 in the "DMZ" of the firewall 248. 
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; ! * Figure 21 illustrates email exchange through a firewall 248 via an email gateway 

f| 260 according to one embodiment. In this example, peers 200A and 200B outside the 
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q 20 firewall 248 may exchange messages to peers 200C and 200D via the email gateway 260. 

■ In one embodiment, there may be an SMTP (Simple Mail Transfer Protocol) service 262 

on each peer 200. In one embodiment, 100% peer-to-peer access may not be guaranteed. 
In one embodiment, inside the firewall 248, mail account administration may impose 
restrictions. In one embodiment, email addresses may not be required for all peers 200 
25 outside of the firewall 248. 



Figure 22 illustrates several methods of traversing a firewall 248 when access is 
initiated from the inside according to one embodiment. One or more peers 200 may be 
inside the firewall 248, and one or more peers 200 may be outside the firewall 248. In 
30 one embodiment, each peer 200 that needs to traverse firewall 248 may include a mini- 



Atty. Dkt. No.: 5681-07400/ P7109 



128 



Conley Rose & Tayon, RC. 



HTTP server. In this embodiment, an HTTP proxy may be used to provide peer-to-peer 
HTTP tunnels 264 through firewall 248. In one embodiment, Secure Shell (SSH) tunnels 
266 may be used to traverse firewall 248. One embodiment may support SOCKS 
connections 268 if SOCKS is supported in the firewall 248. SOCKS is typically used to 
5 telnet/ftp to the "outside". Other embodiments may include other methods of traversing 
firewalls. 
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In one embodiment, peer-to-peer platform core protocols may be used for firewall 
traversal. In one embodiment, the impact on the peer-to-peer protocol core may be 
10 minimized in the traversal method. In one embodiment, peers preferably use the "pure" 
core protocols for traversal whenever possible. In embodiments where the core protocols 
need to be extended for traversal, a "divide and conquer" technique is preferably used. In 
a divide and conquer technique, any new configurations (policies) are preferably isolated 



I*!"' behind the firewall. A proxy or proxies may then be used to mediate with and bridge to 

15 the core protocols. 

Preferably, peers on either side of the firewall may initiate peer group contact with 
full peer-to-peer protocol implementation including, but not limited to, the ability to 
initiate peer group discovery, the ability to join / leave peer groups, and the ability to 
20 create end-to-end pipes (cipher text data exchange when required). 

Figure 23 illustrates one embodiment of a peer-to-peer platform proxy service 
270, and shows various aspects of the operation of the proxy service. One or more peers 
200 may be inside a firewall 248, and one or more peers 200 may be outside the firewall 
25 248. Peer-to-peer platform proxy service 270 is also shown outside the firewall 248. 
Proxy service 270 may be used to enable peer 200 and peer group contact across firewall 
248. Firewall 248 may include an email gateway 260. In one embodiment, the proxy 
service 270 may be used to bridge peer-to-peer platform protocols 272 with HTTP 274, 
email 276 and/or SOCKS 278. The proxy service 270 may allow peers 200 to send 
30 requests to communicate across firewall 248. Through the proxy service 270, peer-to- 
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peer platform messages may be posted for delivery across the firewall 248. In one 
embodiment, the proxy service 270 may allow secure pipes to be established across the 
firewall 248 as necessary. 

Figure 24 illustrates a method of using a proxy service for peer group registration 
according to one embodiment. The proxy service may permit firewall-independent peer 
group membership. Three peer regions 212 are shown, with two (region 212A and 212B) 
on one side of firewall 248 and one (region 212C) on the other side of firewall 248. A 
peer group 210 may be established that extends across the firewall 248 into regions 2 12 A, 
212B and 212C. One or more peers 200 in each region 212 may be members of the peer 
group 210. 

Figure 25 illustrates peer group registration across a firewall according to one 
embodiment. Peer region 212A is shown outside of a firewall 248 and peer region 212B 
is behind the firewall 248. Peer region 212A includes a peer-to-peer platform proxy 
service 270 and several peers 200. In one embodiment, a peer 200 may be serving as a 
proxy peer that provides the proxy service 270. Peer region 212B includes several peers 
200 behind the firewall 248. At some point, peer 200D in peer region 212B may form a 
peer group 210. An advertisement for the peer group 210 may be registered on the proxy 
service 270 in the region 212A. One or more peers 200 in region 212A may be notified 
of the newly registered peer group 200 by the proxy service 270. In one embodiment, the 
proxy service may also notify other known peer-to-peer platform proxy services in this or 
other regions 212, who in turn may notify other proxy services, and so on. Peers 200 in 
region 212A may then apply for membership in peer group 200. 

Figure 26 illustrates a method of providing peer group membership through a 
peer-to-peer platform proxy service according to one embodiment. Peer regions 212A 
and 212B are shown outside of a firewall 248, and peer region 212C is behind the firewall 
248. The two peer group regions 212 outside the firewall 248 each include a proxy 
service 270. At least one of the peers (peer 200F, in this example) in region 212C behind 
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the firewall belongs to a peer group 210. The peer group 210 may be registered with the 
proxy services 270 in the regions 212A and 212B outside the firewall 248. A peer 200 in 
either of the regions outside the firewall may join the peer group 200 by proxy through 
the proxy service 270 in its region 212. Peers 200 in the regions 212 outside the firewall 
248 that are members of the peer group 210 may also leave the peer group 210 through 
the proxy service 270. Membership information (e.g. included in peer group 
advertisements) for the peer group 200 may be synchronized on all known proxy services 
270 outside the firewall 248. In one embodiment, a proxy service 270 may be a member 
peer of all locally registered peer groups 200. 

Several levels of authentication may be provided in one or more embodiments of 
the peer-to-peer platform. Anonymous login may be provided in one embodiment. In 
one embodiment, a plain text login (user or user and password) may be provided. In one 
embodiment, login with privacy may be provided. In this embodiment, public key 
exchange may be used and/or a symmetric master key. The login process preferably 
returns a credential to the joining peer so that the peer may bypass the login process until 
the credential expires. One embodiment may provide a public key chain that may be used 
by registered users to eliminate public key exchanges and thus provides unauthenticated 
access. On embodiment may provide secure public key exchange with signed certificates. 

Figures 27A and 27B illustrate a method of providing privacy in the peer-to-peer 
platform according to one embodiment. Figure 27A shows a peer region 212 with peers 
200A and 200B and a peer-to-peer platform proxy service 270. Peers 200A and 200B 
may fetch and cache public keys from a public key chain 280 of the proxy service 270. 
The cached public keys preferably have expiration dates. Peers 200A and/or 200B may 
compute a master secret key for one or more of the public keys. Using the keys, cipher 
text may be exchanged between peers 200A and 200B in privacy as illustrated in Figure 
27B. 
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The peer-to-peer platform may include one or more methods for providing data 
integrity in the peer-to-peer environment. These methods may be used to insure that what 
is sent is what is received. One embodiment may use a standard hash on data (e.g. Secure 
Hash Algorithm (SHA-1) as defined by the Secure Hash Standard of the Federal 
Information Processing Standards Publication 180-1). A weak form and/or a strong form 
may be used in embodiments. In one embodiment, the weak form may use a public key 
ring and symmetric master to sign data. This method may work best between two peers 
each having he other's public key. In one embodiment, the strong form may use a 
symmetric key algorithm such as RSA (Rivest-Shamir-Adleman) and certificate 
authorities. In one embodiment, the peer-to-peer platform may provide a proxy public 
certificate authority service. The authority service may create, sign and distribute 
certificates (e.g. X509 certificates) for all peers on a public key chain. The proxy 
service's public key is preferably resident on each proxied peer. Other embodiments may 
utilize other integrity methods. 

Figures 28A and 28B illustrate one embodiment of a method for using a peer-to- 
peer platform proxy service as a certificate authority. Figure 28A illustrates a peer region 
212 with several peers 200 and a proxy service 270. The proxy service 270 may 
distribute signed certificates in response to peer requests as required. The peers 200 may 
validate the proxy service 270 signature using a proxy service public key. As illustrated 
in Figure 28B, when exchanging content with other peers 200, a peer 200 may sign the 
content with the destination peer's public key and distribute the cipher text. 

Bootstrapping mechanism 

In the absence of an application, the peer-to-peer platform preferably provides a 
mechanism that may be used to discover basic core abstractions (e.g. peer, peer groups, 
advertisements, pipes). This basic mechanism is needed for bootstrapping a system, and 
so may be referred to as a bootstrapping mechanism. For example, if a user just 
downloaded a binary image that enables a device to become a peer in a peer-to-peer 
network that implements the peer-to-peer platform, the bootstrapping mechanism may be 
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used to discover core abstractions since the "fresh" system may not have knowledge of or 
access to higher-level services. 

The tasks of searching, discovering, and/or routing in a peer-to-peer network may 
be complicated. There are many different types of content, and there may not be a 
genericmechanism to best accomplish those tasks for all types of content. Therefore, 
letting an application or higher-level service perform these high-level search may be 
preferable, while providing simple, small, mechanisms for bootstrapping peer-to-peer 
platform-enabled applications. 

The policies and/or protocols used by the core in order to achieve this 
bootstrapping are preferably as simple as possible and preferably may be implemented 
and used on a wide variety of platforms (e.g. PDAs, pagers, smart appliances, laptops, 
workstations, clusters of servers, etc.) and in a variety of network topologies. For 
example, some peers may not use TCP/IP, and some may not be connected to the Internet. 
The bootstrapping mechanism may be used as a fallback mechanism when nothing else is 
useable (e.g. in case of a failure of higher lever services). The bootstrapping mechanism 
is preferably highly configurable. In one embodiment, configuration "wizards" may be 
used for automatic configuration of the bootstrapping mechanism. 

In one embodiment, other services (e.g. higher-level services and/or optional 
services) and applications may take over control of the bootstrapping mechanism. In one 
embodiment, the core protocols may provide an API or APIs to allow the service and/or 
application to dynamically teach and/or reconfigure the core policies. In one embodiment, 
a service or application may dynamically overload (i.e. replace) the core policies. For 
example, this may be done when the design of the application is so dependant on a 
specific algorithm that it cannot handle the default core policies. 
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Providing the bootstrapping mechanism in the peer-to-peer platform may help to 
allow the peer-to-peer platform to be used straight "out of the box", and/or to be easily 
configured and installed, for use with a peer-to-peer platform-enabled application. 

Peer Monitoring and Metering 

Peer monitoring may include the capability to closely keep track of a (local or 
remote) peer's status, to control the behavior of a peer, and to respond to actions on the 
part of a peer. These capabilities may be useful, for example, when a peer network wants 
to offer premium services with a number of desirable properties such as reliability, 
scalability, and guaranteed response time. For example, a failure in the peer system is 
preferably detected as soon as possible so that corrective actions can be taken. It may be 
preferable to shut down an erratic peer and transfer its responsibilities to another peer. 

Peer metering may include the capability to accurately account for a peer's 
activities, in particular its usage of valuable resources. Such a capability is essential if the 
network economy is to go beyond flat-rate services. Even for providers offering flat rate 
services, it is to their advantage to be able to collect data and analyze usage patterns in 
order to be convinced that a flat rate structure is sustainable and profitable. 

In one embodiment, the peer-to-peer platform may provide monitoring and 
metering through the peer information protocol, where a peer can query another peer for 
data such as up time and amount of data handled. Security is important in peer monitoring 
and metering. In one embodiment, a peer may choose to authenticate any command it 
receives. In one embodiment, a peer may decide to not answer queries from suspect 
sources. 

Peer-to-Peer Platform shell application 

One embodiment of the peer-to-peer platform may include a shell application as a 
development environment built on top of the platform. In one embodiment, the shell 
application may provide interactive access to the peer-to-peer platform via a simple 
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command line interface. With the shell, shell scripts may be written. The shell may be 
executed in a networked environment. A user command in the shell may generate a 
sequence of message exchanges between a set of peers, with some computation occurring 
on remote peer nodes, and with the answer being returned to the user of the shell. Using 
the shell, peer-to-peer core building blocks such as peers, peer groups, pipes, and codats 
may be manipulated. Codats are units of contents that can hold both code and data. For 
example, a user, through the shell, can publish, search, and execute codats, discover peers 
or peer groups, create pipes to connect two peers, and send and receive messages. 

In one embodiment, an interpreter in the shell may operate in a loop: it accepts a 
command, interprets the command, executes the command, and then waits for another 
command. The shell may display a prompt to notify users that it is ready to accept a new 
command. 

In one embodiment with a Java-based implementation of the peer-to-peer 
platform, one or more of the shell commands may not be built in per se. The commands 
may be Java language programs and are dynamically loaded and started by the shell 
framework when the corresponding commands are typed in. Therefore, adding a new 
shell command may be performed by writing a program in the Java language. 

In one embodiment, the shell may provide a "pipe" capability to redirect a 
command output pipe into another command input pipe. In one embodiment, shell 
commands may be given a standard input, output and error pipes that a user can connect, 
disconnect and reconnect to other shell commands. Commands can support other pipes if 
needed. In one embodiment of the shell, a user may dynamically disconnect and 
reconnect pipes between commands, as in the following example: 

xxxx> cat >pl myfile 
xxxx> grep <pl abed 
xxxx> grep <pl efgh 
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In the above example, the first command "cat >pl myfile" cats myfile into the 
output pipe pi. The second command then connects pipe pi to grep's input pipe and 
searches for the string abed. The third command then disconnects pi, redirects it to the 
new grep command's input pipe and searches for the string efgh. 

In one embodiment, the peer-to-peer platform shell supports piping in both 
directions. A special operator such as "<>" may used for creating crossing pipes between 
two commands. For example, with the following command "cmdl <> cmd2", the output 
pipe of the first command is connected to the standard input pipe of the second command, 
and at the same time the output pipe of the second command is connected to the standard 
input pipe of the first command. Of course, this operator has to be used carefully to avoid 
infinite data loops. 

In one embodiment, applications other than peer-to-peer platform applications 
may be run from the shell. For content management, MIME type information included 
with a codat may be used to let local applications associated with well-known content 
types handle them automatically. The peer-to-peer platform may support the development 
of adaptors to allow the execution of external programs with appropriate security 
safeguards. An adapter may essentially map data and connect applications for remote 
launches. Some examples might be: 

• UNIX® stdio to peer-to-peer platform stdio adapter - such an adaptor may enable 
piping of peer-to-peer platform commands to UNIX® commands on UNIX® 
platforms. 

• Peer-to-peer platform stream to a media player adapter - such an adaptor may be 
platform- and application-specific, but may handle any necessary real-time data 
conversion between a peer-to-peer platform pipe and the format required by the 
player. These need not be unidirectional. For example, one might adapt the output 
of a video capture application to become a peer-to-peer platform stream. 
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• HTML to peer-to-peer platform stdio - such an adaptor may be used to post and 
get information to/from Web pages to allow peer-to-peer platform peers to interact 
with existing Web sites. For example, a peer-to-peer platform command can 
launch a search for titles and prices on Amazon and pipe the results to other peer- 
to-peer platform services. 

Conclusion 

Various embodiments may further include receiving, sending or storing 
instructions and/or data implemented in accordance with the foregoing description upon a 
carrier medium. Generally speaking, a carrier medium may include storage media or 
memory media such as magnetic or optical media, e.g., disk or CD-ROM, volatile or non- 
volatile media such as RAM (e.g. SDRAM, DDR SDRAM, RDRAM, SRAM, etc.), 
ROM, etc. as well as transmission media or signals such as electrical, electromagnetic, or 
digital signals, conveyed via a communication medium such as network and/or a wireless 
link. 

Various modifications and changes may be made as would be obvious to a person 
skilled in the art having the benefit of this disclosure. It is intended that the invention 
embrace all such modifications and changes and, accordingly, the above description to be 
regarded in an illustrative rather than a restrictive sense. 
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